-- Logs begin at Sun 2022-08-07 21:36:41 UTC, end at Sun 2022-08-07 23:00:10 UTC. -- Aug 07 22:28:58.970034 dv-cinder-850321-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 07 22:28:58.979010 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 07 22:28:58.981002 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 7 22:28:58 2022] *** Aug 07 22:28:58.981002 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 07 22:28:58.981002 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 07 22:28:58.981002 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: nodename: dv-cinder-850321-3-iscsi Aug 07 22:28:58.981002 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: machine: x86_64 Aug 07 22:28:58.981002 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: clock source: unix Aug 07 22:28:58.981002 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: pcre jit disabled Aug 07 22:28:58.981002 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: detected number of CPU cores: 4 Aug 07 22:28:58.981002 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: current working directory: / Aug 07 22:28:58.981002 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: detected binary path: /usr/bin/uwsgi-core Aug 07 22:28:58.981674 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: your processes number limit is 47680 Aug 07 22:28:58.981674 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: your memory page size is 4096 bytes Aug 07 22:28:58.981674 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: detected max file descriptor number: 2048 Aug 07 22:28:58.981674 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: lock engine: pthread robust mutexes Aug 07 22:28:58.981674 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: thunder lock: enabled Aug 07 22:28:58.981674 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 07 22:28:58.981674 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 07 22:28:59.021298 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: Python main interpreter initialized at 0x558a8a60d9c0 Aug 07 22:28:59.021298 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: python threads support enabled Aug 07 22:28:59.021298 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: your server socket listen backlog is limited to 100 connections Aug 07 22:28:59.021298 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: your mercy for graceful operations on workers is 90 seconds Aug 07 22:28:59.021628 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: mapped 403077 bytes (393 KB) for 2 cores Aug 07 22:28:59.021706 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: *** Operational MODE: preforking *** Aug 07 22:28:59.021963 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: *** uWSGI is running in multiple interpreter mode *** Aug 07 22:28:59.021963 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: spawned uWSGI master process (pid: 103835) Aug 07 22:28:59.022157 dv-cinder-850321-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 07 22:28:59.022694 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: spawned uWSGI worker 1 (pid: 103836, cores: 1) Aug 07 22:28:59.023030 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: spawned uWSGI worker 2 (pid: 103837, cores: 1) Aug 07 22:28:59.023209 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 07 22:28:59.683140 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 07 22:28:59.683940 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 07 22:29:00.764802 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 22:29:00.764802 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: from cryptography.utils import int_from_bytes Aug 07 22:29:00.765543 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 22:29:00.765543 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: from cryptography.utils import int_from_bytes Aug 07 22:29:00.765951 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 22:29:00.765951 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: from cryptography.utils import int_from_bytes Aug 07 22:29:00.766087 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 22:29:00.766087 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: from cryptography.utils import int_from_bytes Aug 07 22:29:03.265335 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 22:29:03.266435 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 22:29:03.266747 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 22:29:03.267097 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 22:29:03.267352 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 22:29:03.267741 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.268108 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.268301 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 22:29:03.268667 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.268759 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 22:29:03.268845 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.269055 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.269140 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 22:29:03.269368 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.269461 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 22:29:03.269659 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 22:29:03.269754 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.269996 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.270080 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.270324 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.270410 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.270584 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.270670 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.270901 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.270984 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.271225 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850321-3-iscsi {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.271317 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.271546 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.271643 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.271853 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.271948 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.272201 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.272288 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.272521 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.272614 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.272780 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.272881 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.273097 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.273182 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.273422 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850321-3-iscsi {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.273518 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.273741 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.273918 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.274046 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.274364 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.274497 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.274664 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.274768 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.275004 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.275101 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.275294 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.275387 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.275598 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.275700 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.275914 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.276126 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.276295 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.276439 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.276615 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.276761 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.276882 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.277045 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.277200 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.277383 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.277577 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850321-3-iscsi {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.277687 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.277895 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.277992 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.278215 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.278310 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.278524 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.278628 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.278908 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.279012 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.279218 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.279312 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.279523 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.279626 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850321-3-iscsi {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.279843 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.279952 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.280193 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.280310 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.280505 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.280597 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.280831 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.280986 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.281194 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.281367 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.281665 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.281768 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.281985 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.282076 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.282299 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.282400 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.282605 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.282696 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.282914 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.283009 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.283234 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.283325 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.283537 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.283629 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.283843 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.283935 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.284111 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.284217 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.284424 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.284529 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.284745 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.284838 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.285065 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.285163 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.285371 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.285464 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.285632 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.285795 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.285937 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.286089 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.286229 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.286370 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.286529 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.286686 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.286827 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.286966 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.287105 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.287244 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.287396 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.287536 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.287738 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.287880 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.288062 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.288230 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.288385 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.288536 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.288679 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.288825 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.289117 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.289278 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.289428 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.289585 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.289782 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.289956 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.290119 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.290270 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.290446 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.290609 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.290761 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.290913 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.291053 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.291207 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.291348 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.291547 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.291722 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.291885 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.292057 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.292243 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.292417 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.292557 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.292696 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.292835 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.292983 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.292983 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.293257 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.293257 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.293546 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.293684 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.293831 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.293831 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.294100 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.294257 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.294396 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.294534 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.294680 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.294828 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.294976 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.295115 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.295253 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.295390 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.295537 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.295685 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.295831 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.295970 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.296154 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.296303 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.296456 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.296597 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.296742 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.296881 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.297029 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.297238 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.297381 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.297519 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.297710 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.297882 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.298130 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.298314 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.298466 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.298603 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.298750 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.298888 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.299179 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.299338 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.299486 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.299626 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.299764 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.299902 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.300080 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.300240 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.300392 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.300532 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.300680 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.300820 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.300968 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.301108 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.301249 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.301387 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.301524 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.301662 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.301809 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.301950 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.302115 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.302255 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.302394 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.302540 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.302689 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.302828 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.302966 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.303112 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.303265 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.303409 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.303556 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.303696 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.303835 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.303996 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.304179 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.304317 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.304470 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.304617 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.304758 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.304896 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.305042 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.305181 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.305328 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.305468 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.305607 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.305753 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.305910 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.306050 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.306204 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.306344 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.306484 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.306630 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.306769 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.306907 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.307056 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.307202 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.307341 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.307479 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.307626 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.307827 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.307980 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.308179 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.308329 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.308476 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.308617 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.308766 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.308907 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.309046 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.309325 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.309471 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.309620 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.309838 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.309997 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.310138 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.310276 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.310414 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.310559 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.310708 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.310861 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.311000 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.311139 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.311278 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.311426 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.311566 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.311716 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.311855 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.311993 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.312168 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.312820 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.313016 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:29:03.313207 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.313351 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.313351 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.313615 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.313615 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.313889 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.314035 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.314186 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.314326 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.314465 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.314614 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.314760 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.314900 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.315039 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.315178 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.315329 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.315481 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.315627 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.315780 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.315937 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.316141 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.316297 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.316438 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.316598 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.316752 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.316899 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.317040 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.317188 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.317328 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.317474 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.317613 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.317759 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.317953 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.318113 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.318255 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.318394 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.318540 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.318680 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.318820 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.318978 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.319133 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.319417 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.319567 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.319708 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.319857 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.320036 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.320185 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.320324 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.320463 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.320601 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.320757 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.320897 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.321042 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.321191 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.321331 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.321476 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.321625 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.321775 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.321915 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.322054 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.322202 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.322343 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.322494 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.322635 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.322774 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.322912 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.323058 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.323214 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.323365 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.323515 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.323673 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.323812 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.323962 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.324159 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.324304 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.324450 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.324591 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.324743 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.324884 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.325037 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.325177 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.325317 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.325457 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.325606 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.325746 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.325894 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.326034 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.326174 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.326313 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.326454 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.326593 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.326742 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.326882 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.327021 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.327160 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.327306 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.327465 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.327670 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.327824 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.328629 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.328770 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.328934 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.329092 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.329234 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.329525 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.329676 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.329824 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.329965 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.330117 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.330269 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.330415 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.330569 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.330710 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.330851 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.331003 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.331156 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.331296 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.331437 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.331583 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.331732 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.331881 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.332072 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.332230 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.332372 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.332511 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.332739 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.332883 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.333029 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.333178 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.333328 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.333467 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.333619 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.333761 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.333901 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.334051 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.334191 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.334330 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.334479 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.334619 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.334759 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.334899 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.335039 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.335188 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.335335 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.335483 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.335623 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.335768 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.335926 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.336102 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.336257 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.336397 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.336538 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.336684 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.336684 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.336964 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.337104 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.337243 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.337382 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.337521 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.337677 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.337836 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.337836 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.338102 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.338241 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.338380 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.338559 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.338717 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.338865 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.339013 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.339154 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.339293 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.339441 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.339746 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.339899 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.340065 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.340212 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.340352 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.340503 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.340645 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.340784 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.340931 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.341081 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.341221 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.341373 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.341513 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.341663 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.341803 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.341949 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.342097 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.342247 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.342387 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.342527 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.342667 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.343211 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.343371 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.343371 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.343371 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.343851 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.344002 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.344206 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.344359 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.344507 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.344647 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.344787 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.344934 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.345075 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.345231 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.345383 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.345530 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.345679 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.345829 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.345976 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.346124 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.346277 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.346418 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.346557 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.346697 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.346844 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.346985 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.347124 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.347263 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.347402 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.347541 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.347710 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.347850 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.347989 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.348157 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.348298 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.348451 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.348601 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.348796 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.348937 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.349076 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.349215 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.349355 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.349507 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.349801 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.349951 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.350092 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.350239 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.350393 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.350546 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.350686 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.350833 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.350972 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.351111 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.351258 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.351405 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.351546 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.351696 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.351836 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.351975 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.352187 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.352336 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.352482 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.352636 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.352782 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.352927 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.353081 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.353238 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.353383 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.353542 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.353706 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.353854 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.354007 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.354154 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.354299 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.354445 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.354599 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.354755 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.354901 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.355053 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.355199 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.355345 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.355490 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.355657 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.355812 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.355959 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.356148 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.356296 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.356442 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.356599 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.356754 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.356903 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.357056 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.357202 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.357354 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.357520 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.357675 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.357831 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.357986 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.358133 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.358292 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.358447 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.358601 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.358789 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.358948 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.359619 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.359923 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.360131 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.360305 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.360454 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.360607 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.360607 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.360909 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.361065 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.361221 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.361368 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.361515 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.361668 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.361668 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.362034 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.362188 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.362345 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.362491 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.362645 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.362800 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.362955 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.363102 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.363249 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.363394 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.363553 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.363706 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.363853 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.364007 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.364191 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.364357 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.364514 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.364661 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.364819 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.364972 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.365118 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.365265 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.365421 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.365567 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.365712 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.365857 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.366002 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.366157 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.366315 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.366461 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.366670 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.366842 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.367000 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.367155 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.367313 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.367469 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.367616 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.367763 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.367917 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.368131 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.368303 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.368452 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.368598 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.368744 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.368943 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.369100 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.369247 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.369394 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.369540 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.369806 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.370121 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.370277 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.370424 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.370581 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.370726 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.370870 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.371024 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.371179 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.371333 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.371480 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.371625 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.371777 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.371937 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.372114 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.372264 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.372409 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.372577 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.372749 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.372910 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.373056 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.373201 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.373346 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.373346 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.373644 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.373801 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.373955 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.374100 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.374246 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.374246 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.374551 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.374755 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.374911 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.375066 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.375214 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.375360 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.375765 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.375914 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.376090 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.376244 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.376413 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.376570 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.376729 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.376884 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.377030 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.377183 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.377337 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.377492 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.377651 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.377806 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.377961 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.378107 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.378252 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.378399 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.378552 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.378715 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.378915 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.379075 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.379223 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.379369 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.379523 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.379669 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.379824 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.379973 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.380192 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.380348 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.380495 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.380640 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.380805 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.380953 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.381098 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.381251 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.381397 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.381552 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.381705 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.381851 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.381997 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.382143 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.382288 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.382441 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.382598 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.382744 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.382889 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.383036 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.383181 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.383335 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.383482 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.383637 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.383784 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.383929 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.384136 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.384288 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.384433 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.384590 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.384736 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.384881 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.385035 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.385183 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.385329 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.385474 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.385619 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.385765 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.385984 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.386135 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.386288 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.386435 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.386592 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.386738 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.386893 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.387039 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.387185 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.387330 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.387476 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.387634 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.387788 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.387934 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.388101 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.388251 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.388408 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.388566 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.388714 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.388858 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.389054 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.389206 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.389354 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.389513 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.389660 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.389814 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.389960 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.390107 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.390252 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.390939 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.391096 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.391244 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.391391 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.391545 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.391701 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.391848 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.391995 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.392200 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.392346 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.392504 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.392660 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.392815 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.392972 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.393118 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.393264 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.393409 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.393569 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.393717 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.393862 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.394013 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.394164 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.394318 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.394473 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.394621 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.394766 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.394928 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.395075 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.395230 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.395377 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.395522 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.395676 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.395823 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.395968 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.396152 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.396300 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.396446 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.396592 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.396738 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.396900 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.397056 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.397203 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.397348 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.397494 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.397639 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.397793 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.398036 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.398203 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.398353 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.398507 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.398654 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.398821 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.398969 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.399157 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.399308 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.399454 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.399608 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.399765 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.399912 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.400089 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.400243 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.400390 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.400547 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.400707 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.400869 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.401015 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.401161 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.401306 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.401451 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.401609 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.401756 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.401903 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.402048 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.402200 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.402354 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.402507 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.402654 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.402813 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.402960 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.403105 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.403259 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.403406 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.403552 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.403705 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.403858 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.404029 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.404196 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.404345 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.404491 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.404636 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.404791 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.404943 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.405104 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.405251 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.405396 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.405540 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.405685 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.405839 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.406034 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.406184 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.406337 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.406484 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.406638 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.406802 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.406956 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.407104 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.407257 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.407404 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.407550 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.407709 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.407857 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.408038 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.408194 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.408341 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.408487 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.408649 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.408808 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.408954 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.409107 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.409304 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.409456 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.409610 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.409758 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.409903 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.410056 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.410203 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.410362 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.410509 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.410672 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.410818 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.410964 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.411109 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.411263 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.411410 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.411555 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.411701 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.411846 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.411999 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.412203 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.412353 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.412511 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.412677 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.412825 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.412971 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.413129 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.413276 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.413423 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.413569 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.413723 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.413879 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.414040 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.414191 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.414337 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.414483 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.414638 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.414856 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.415005 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.415151 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.415296 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.415442 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.415588 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.415746 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.415894 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.416063 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.416216 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.416361 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.416517 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.416678 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.416825 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.416971 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.417116 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.417260 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.417414 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.417560 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.417707 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.417851 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.417997 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.418142 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.418297 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.418461 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.418608 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.418763 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.418910 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.419055 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.419209 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.419396 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.419547 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.419694 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.419839 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.419993 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.420211 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.420360 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.420518 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.420672 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.420819 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.420973 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.421120 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.421266 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.421412 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.422069 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.422224 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.422380 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.422536 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.422748 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.422902 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.423060 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.423207 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.423363 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.423517 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.423663 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.423809 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.423963 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.424135 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.424296 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.424443 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.424599 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.424746 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.424916 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.425077 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.425232 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.425386 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.425540 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.425688 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.425841 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.425998 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.426145 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.426291 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.426455 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.426615 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.426763 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.426932 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.427088 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.427242 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.427395 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.427564 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.427720 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.427874 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.428077 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.428245 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.428394 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.428541 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.428694 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.428842 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.428998 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.429155 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.429302 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.429491 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.429644 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.429790 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.429944 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.430091 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.430245 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.430392 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.430538 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.430692 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.430857 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.431005 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.431159 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.431306 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.431452 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.431597 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.431752 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.431906 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.432076 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.432229 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.432377 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.432535 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.432691 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.432848 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.432848 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.433125 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.433272 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.433428 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.433428 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.433705 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.433850 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.433997 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.434143 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.434302 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.434451 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.434607 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.434764 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.434924 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.434924 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.435211 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.435358 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.435513 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.435513 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.435791 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.435791 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.436132 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.436132 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.436424 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.436571 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.436737 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.436893 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.437040 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.437240 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.437404 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.437553 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.437700 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.437855 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.438002 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.438156 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.438303 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.438449 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.438607 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.438763 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.438910 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.439056 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.439210 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.439367 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.439558 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.439723 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.439872 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.440043 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.440197 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.440344 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.440502 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.440661 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.440808 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.440955 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.441108 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.441262 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.441427 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.441575 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.441730 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.441897 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.442045 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.442199 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.442359 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.442514 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.442673 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.442821 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.442974 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.443121 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.443280 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.443442 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.443590 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.443736 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.443883 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.444078 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.444234 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.444380 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.444556 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.444708 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.444863 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.445026 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.445181 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.445336 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.445496 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.445645 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.445791 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.445947 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.446095 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.446242 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.446396 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.446554 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.446701 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.446857 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.447013 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.447161 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.447308 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.447462 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.447618 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.447773 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.447921 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.448091 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.448253 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.448410 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.448576 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.448725 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.448725 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.449003 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.449003 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.449290 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.449290 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.449627 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.449779 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.449927 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.450074 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.450230 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.450390 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.450548 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.450702 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.450857 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.451005 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.451162 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.451309 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.451464 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.451612 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.451759 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.451912 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.452124 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.452294 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.452449 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.452606 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.452753 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.453439 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.453598 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.453746 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.453893 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.454048 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.454195 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.454343 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.454539 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.454688 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.454844 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.455010 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.455177 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.455334 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.455491 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.455639 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.455786 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.455786 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.456085 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.456250 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.456400 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.456546 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.456699 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.456853 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.457012 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.457168 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.457315 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.457461 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.457608 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.457754 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.457915 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.458070 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.458225 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.458372 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.458520 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.458666 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.458840 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.458989 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.459135 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.459282 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.459428 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.459576 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.459777 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.459938 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.460136 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.460288 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.460450 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.460619 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.460767 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.460916 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.461070 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.461217 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.461440 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.461589 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.461745 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.461892 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.462046 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.462192 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.462351 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.462509 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.462663 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.462811 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.462958 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.463104 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.463262 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.463410 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.463556 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.463702 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.463849 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.464028 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.464188 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.464335 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.464492 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.464639 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.464796 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.464953 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.465110 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.465258 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.465404 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.465550 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.465696 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.465696 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.465996 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.466143 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.466300 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.466447 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.466593 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.466593 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.466967 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.467126 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.467275 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.467421 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.467575 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.467724 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.467877 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.468066 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.468221 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.468379 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.469210 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.469469 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.469689 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.469921 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.470073 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.470220 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.470382 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.470531 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.470686 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.470834 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.470980 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.471138 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.471294 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.471442 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.471588 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.471734 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.471881 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.472058 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.472214 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.472214 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.472514 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.472663 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.472817 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.472973 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.473131 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.473131 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.473410 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.473558 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.473704 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.473859 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.474007 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.474154 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.474302 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.474448 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.474604 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.474752 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.474899 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.475073 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.475233 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.475382 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.475538 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.475685 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.475831 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.475978 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.476169 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.476318 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.476477 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.476625 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.476771 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.476916 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.477073 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.477219 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.477375 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.477523 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.477670 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.477823 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.477970 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.478125 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.478284 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.478434 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.478580 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.478726 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.478882 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.479037 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.479191 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.479338 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.479485 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.479631 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.479778 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.479979 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.480155 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.480302 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.480449 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.480607 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.480754 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.480924 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.481072 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.481226 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.481374 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.481528 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.481676 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.481830 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.481985 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.482132 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.482278 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.482423 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.482577 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.482727 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.482883 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.483036 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.483190 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.483337 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.483491 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.483638 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.483785 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.483930 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.484157 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.484356 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.484564 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.484716 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.484876 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.485050 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.485201 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.485348 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.485503 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.485650 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.485804 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.485952 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.486106 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.486266 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.486413 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.486413 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.486698 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.486858 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.487005 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.487160 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.487308 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.487462 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.487610 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.487763 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.487912 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.488090 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.488245 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.488391 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.488538 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.488684 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.488853 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.489010 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.489157 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.489303 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.489449 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.489604 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.489759 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.489906 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.490093 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.490253 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.490400 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.490546 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.490701 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.490859 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.491006 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.491152 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.491298 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.491444 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.491599 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.491747 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.491892 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.492097 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.492253 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.492415 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.492565 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.492721 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.492876 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.493031 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.493179 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.493334 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.493482 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.493629 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.493775 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.493930 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.494078 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.494238 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.494387 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.494543 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.494690 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.494843 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.495011 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.495163 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.495318 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.495465 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.495611 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.495757 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.495913 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.496092 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.496247 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.496394 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.496552 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.496706 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.496863 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.497010 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.497157 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.497306 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.497453 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.497672 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.497821 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.498027 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.498027 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.498312 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.498470 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.498631 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.498631 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.498909 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.499056 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.499202 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.499348 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.499503 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.499681 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.499871 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.500239 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.500706 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.500888 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.501037 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.501193 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.501342 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.501491 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.501637 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.501796 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.501945 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.502092 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.502245 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.502393 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.502541 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.502697 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.502856 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.503011 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.503158 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.503312 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.503469 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.503619 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.503766 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.503920 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.504091 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.504091 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.504404 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.504553 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.504719 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.504867 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.505021 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.505021 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.505313 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.505313 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.505600 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.505748 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.505894 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.505894 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.506179 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.506327 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.506481 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.506645 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.506794 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.506794 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.507090 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.507237 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.507383 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.507383 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.507676 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.507833 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.507981 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.508176 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.508325 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.508481 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.508639 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.508798 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.508947 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.508947 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.509225 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.509370 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.509517 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.509676 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.509831 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.509980 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.510133 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.510323 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.510484 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.510643 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.510790 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.510937 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.511084 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.511229 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.511384 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.511532 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.511678 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.511825 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.511971 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.512145 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.512308 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.512474 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.512622 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.512768 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.512921 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.513070 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.513224 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.513371 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.513532 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.513679 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.513825 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.513980 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.514136 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.514283 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.514440 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.514586 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.514733 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.514889 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.515047 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.515196 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.515920 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.516109 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.516262 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.516422 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.516579 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.516727 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.516874 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.517031 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.517187 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.517344 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.517500 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.517660 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.517809 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.517955 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.518110 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.518258 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.518405 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.518552 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.518697 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.518861 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.519018 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.519165 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.519320 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.519475 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.519622 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.519777 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.519933 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.520138 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.520290 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.520484 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.520633 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.520802 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.520952 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.521112 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.521261 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.521408 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.521557 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.521713 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.521861 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.522008 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.522155 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.522302 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.522458 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.522606 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.522764 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.522911 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.523066 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.523215 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.523370 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.523529 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.523685 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.523833 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.523980 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.524172 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.524335 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.524489 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.524647 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.524801 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.524948 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.525109 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.525269 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.525423 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.525575 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.525723 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.525870 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.526025 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.526173 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.526320 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.526466 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.526466 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 22:29:03.526756 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.526756 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:29:03.526756 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 22:29:03.677621 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO dbcounter [None req-e2bd4c55-1df5-4b96-b44d-ece20c3c6028 None None] Registered counter for database nova_api Aug 07 22:29:03.678582 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO dbcounter [None req-204d5ed9-639c-4860-add1-3fa4110f1853 None None] Registered counter for database nova_api Aug 07 22:29:03.698436 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG oslo_db.sqlalchemy.engines [None req-e2bd4c55-1df5-4b96-b44d-ece20c3c6028 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 22:29:03.701034 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_db.sqlalchemy.engines [None req-204d5ed9-639c-4860-add1-3fa4110f1853 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103836) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 22:29:03.706074 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG dbcounter [-] [103837] Writer thread running {{(pid=103837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 22:29:03.708068 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG dbcounter [-] [103836] Writer thread running {{(pid=103836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 22:29:03.763419 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.context [None req-e2bd4c55-1df5-4b96-b44d-ece20c3c6028 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6956e3f3-38cc-4e73-875d-dafdec061360(cell1) {{(pid=103837) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 22:29:03.763659 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.context [None req-204d5ed9-639c-4860-add1-3fa4110f1853 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6956e3f3-38cc-4e73-875d-dafdec061360(cell1) {{(pid=103836) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 22:29:03.768390 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG oslo_concurrency.lockutils [None req-e2bd4c55-1df5-4b96-b44d-ece20c3c6028 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:29:03.768518 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-204d5ed9-639c-4860-add1-3fa4110f1853 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:29:03.768810 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG oslo_concurrency.lockutils [None req-e2bd4c55-1df5-4b96-b44d-ece20c3c6028 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:29:03.768913 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-204d5ed9-639c-4860-add1-3fa4110f1853 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:29:03.770381 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-204d5ed9-639c-4860-add1-3fa4110f1853 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:29:03.770496 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG oslo_concurrency.lockutils [None req-e2bd4c55-1df5-4b96-b44d-ece20c3c6028 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:29:03.771103 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG oslo_concurrency.lockutils [None req-e2bd4c55-1df5-4b96-b44d-ece20c3c6028 None None] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:29:03.771194 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-204d5ed9-639c-4860-add1-3fa4110f1853 None None] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:29:03.771543 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-204d5ed9-639c-4860-add1-3fa4110f1853 None None] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:29:03.771633 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG oslo_concurrency.lockutils [None req-e2bd4c55-1df5-4b96-b44d-ece20c3c6028 None None] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:29:03.773541 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-204d5ed9-639c-4860-add1-3fa4110f1853 None None] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:29:03.773636 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG oslo_concurrency.lockutils [None req-e2bd4c55-1df5-4b96-b44d-ece20c3c6028 None None] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:29:03.775485 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO dbcounter [None req-204d5ed9-639c-4860-add1-3fa4110f1853 None None] Registered counter for database nova_cell0 Aug 07 22:29:03.775588 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO dbcounter [None req-e2bd4c55-1df5-4b96-b44d-ece20c3c6028 None None] Registered counter for database nova_cell0 Aug 07 22:29:03.780989 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO dbcounter [None req-e2bd4c55-1df5-4b96-b44d-ece20c3c6028 None None] Registered counter for database nova_cell1 Aug 07 22:29:03.781202 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO dbcounter [None req-204d5ed9-639c-4860-add1-3fa4110f1853 None None] Registered counter for database nova_cell1 Aug 07 22:29:03.788505 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_db.sqlalchemy.engines [None req-204d5ed9-639c-4860-add1-3fa4110f1853 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103836) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 22:29:03.790020 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG oslo_db.sqlalchemy.engines [None req-e2bd4c55-1df5-4b96-b44d-ece20c3c6028 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 22:29:03.792516 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG oslo_db.sqlalchemy.engines [None req-e2bd4c55-1df5-4b96-b44d-ece20c3c6028 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 22:29:03.794207 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_db.sqlalchemy.engines [None req-204d5ed9-639c-4860-add1-3fa4110f1853 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103836) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 22:29:03.796291 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG dbcounter [-] [103836] Writer thread running {{(pid=103836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 22:29:03.800661 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG dbcounter [-] [103837] Writer thread running {{(pid=103837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 22:29:03.802680 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG dbcounter [-] [103837] Writer thread running {{(pid=103837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 22:29:03.936153 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG dbcounter [-] [103836] Writer thread running {{(pid=103836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 22:29:03.946471 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO dbcounter [None req-204d5ed9-639c-4860-add1-3fa4110f1853 None None] Registered counter for database nova_cell0 Aug 07 22:29:03.956000 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO dbcounter [None req-e2bd4c55-1df5-4b96-b44d-ece20c3c6028 None None] Registered counter for database nova_cell0 Aug 07 22:29:03.956575 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_db.sqlalchemy.engines [None req-204d5ed9-639c-4860-add1-3fa4110f1853 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103836) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 22:29:03.961046 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG dbcounter [-] [103836] Writer thread running {{(pid=103836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 22:29:03.963227 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG oslo_db.sqlalchemy.engines [None req-e2bd4c55-1df5-4b96-b44d-ece20c3c6028 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 22:29:03.967512 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG dbcounter [-] [103837] Writer thread running {{(pid=103837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 22:29:04.378069 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: WARNING keystonemiddleware.auth_token [None req-204d5ed9-639c-4860-add1-3fa4110f1853 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 22:29:04.385282 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: WARNING keystonemiddleware.auth_token [None req-204d5ed9-639c-4860-add1-3fa4110f1853 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 22:29:04.390213 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: WARNING keystonemiddleware.auth_token [None req-e2bd4c55-1df5-4b96-b44d-ece20c3c6028 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 22:29:04.397410 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: WARNING keystonemiddleware.auth_token [None req-e2bd4c55-1df5-4b96-b44d-ece20c3c6028 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 22:29:04.725168 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: WARNING keystonemiddleware.auth_token [None req-204d5ed9-639c-4860-add1-3fa4110f1853 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 22:29:04.731020 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: WARNING keystonemiddleware.auth_token [None req-204d5ed9-639c-4860-add1-3fa4110f1853 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 22:29:04.736321 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558a8a60d9c0 pid: 103836 (default app) Aug 07 22:29:04.737282 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: WARNING keystonemiddleware.auth_token [None req-e2bd4c55-1df5-4b96-b44d-ece20c3c6028 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 22:29:04.738371 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-204d5ed9-639c-4860-add1-3fa4110f1853 None None] Calling method '>' {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:29:04.739532 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-204d5ed9-639c-4860-add1-3fa4110f1853 None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001709 Aug 07 22:29:04.739931 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Sun Aug 7 22:29:04 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:29:04.743188 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: WARNING keystonemiddleware.auth_token [None req-e2bd4c55-1df5-4b96-b44d-ece20c3c6028 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 22:29:04.748274 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558a8a60d9c0 pid: 103837 (default app) Aug 07 22:30:24.047115 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-204d5ed9-639c-4860-add1-3fa4110f1853 None None] Calling method '>' {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:30:24.048317 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-204d5ed9-639c-4860-add1-3fa4110f1853 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Aug 07 22:30:24.048904 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 22:30:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:30:24.061112 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG dbcounter [-] [103837] Writing DB stats nova_api:SELECT=3 {{(pid=103837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:30:24.061976 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG dbcounter [-] [103837] Writing DB stats nova_cell1:SELECT=3 {{(pid=103837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:30:24.062979 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG dbcounter [-] [103837] Writing DB stats nova_cell0:SELECT=3 {{(pid=103837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:30:24.063875 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG dbcounter [-] [103837] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:30:24.948265 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-0cccf62c-0da0-4093-9f71-e597776684cc admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:30:24.994529 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-0cccf62c-0da0-4093-9f71-e597776684cc admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.938232 Aug 07 22:30:24.995392 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1292 bytes} [Sun Aug 7 22:30:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:30:27.279964 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-204d5ed9-639c-4860-add1-3fa4110f1853 None None] Calling method '>' {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:30:27.281502 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-204d5ed9-639c-4860-add1-3fa4110f1853 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 07 22:30:27.287702 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 3/4] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 22:30:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:30:27.736334 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-aacc10fb-8493-407d-89e7-470b24c565e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "c1", "ram": 256, "disk": 1, "rxtx_factor": 1.0}} {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:30:27.757783 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 22:30:27.757783 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: warnings.warn(msg) Aug 07 22:30:27.849234 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-aacc10fb-8493-407d-89e7-470b24c565e2 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.559808 Aug 07 22:30:27.849749 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 2/5] 10.222.0.30 () {64 vars in 1283 bytes} [Sun Aug 7 22:30:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:30:27.864988 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG dbcounter [-] [103836] Writing DB stats nova_api:SELECT=3 {{(pid=103836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:30:27.866521 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG dbcounter [-] [103836] Writing DB stats nova_cell1:SELECT=3 {{(pid=103836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:30:27.867848 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG dbcounter [-] [103836] Writing DB stats nova_cell0:SELECT=3 {{(pid=103836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:30:27.868981 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG dbcounter [-] [103836] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:30:28.079576 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-f441f101-e1ff-40c9-a66b-dcfa71ab597d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:30:28.081333 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 22:30:28.081333 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: warnings.warn(msg) Aug 07 22:30:28.229228 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-f441f101-e1ff-40c9-a66b-dcfa71ab597d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.369838 Aug 07 22:30:28.229823 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 4/6] 10.222.0.30 () {64 vars in 1336 bytes} [Sun Aug 7 22:30:27 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:30:30.591385 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-aacc10fb-8493-407d-89e7-470b24c565e2 admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:30:30.593075 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-aacc10fb-8493-407d-89e7-470b24c565e2 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002487 Aug 07 22:30:30.593984 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 3/7] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 22:30:30 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:30:31.402840 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-6b98ea17-842d-4cb5-8134-5c6c433e749b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "os-flavor-access:is_public": true, "id": "d1", "ram": 512, "vcpus": 1}} {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:30:31.424592 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 22:30:31.424592 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: warnings.warn(msg) Aug 07 22:30:31.542006 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-6b98ea17-842d-4cb5-8134-5c6c433e749b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.940449 Aug 07 22:30:31.544341 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 5/8] 10.222.0.30 () {64 vars in 1283 bytes} [Sun Aug 7 22:30:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:30:31.555504 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-57201670-9259-4bc3-84c4-7fca53e522ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:30:31.558300 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 22:30:31.558300 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: warnings.warn(msg) Aug 07 22:30:31.654540 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-57201670-9259-4bc3-84c4-7fca53e522ed admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102198 Aug 07 22:30:31.656545 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 4/9] 10.222.0.30 () {64 vars in 1336 bytes} [Sun Aug 7 22:30:31 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:30:34.087539 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-6b98ea17-842d-4cb5-8134-5c6c433e749b admin admin] Calling method '>' {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:30:34.089372 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-6b98ea17-842d-4cb5-8134-5c6c433e749b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002243 Aug 07 22:30:34.089847 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 22:30:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:30:34.528965 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-17862e7e-48f1-43c7-b330-5424a6cb6f61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 10, "ram": 1024, "id": "d2", "vcpus": 1}} {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:30:34.608482 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-17862e7e-48f1-43c7-b330-5424a6cb6f61 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.511281 Aug 07 22:30:34.609307 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 5/11] 10.222.0.30 () {64 vars in 1283 bytes} [Sun Aug 7 22:30:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 22:30:34.621297 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-f3004940-5e52-4c8b-852c-50742c1483f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:30:34.700834 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-f3004940-5e52-4c8b-852c-50742c1483f9 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083044 Aug 07 22:30:34.716121 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 7/12] 10.222.0.30 () {64 vars in 1336 bytes} [Sun Aug 7 22:30:34 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:30:37.033767 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-17862e7e-48f1-43c7-b330-5424a6cb6f61 admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:30:37.033767 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-17862e7e-48f1-43c7-b330-5424a6cb6f61 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Aug 07 22:30:37.033767 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 6/13] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 22:30:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:30:37.603468 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-defef230-1c4b-4663-80c7-436e04b34a16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "ram": 2048}} {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:30:37.714175 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-defef230-1c4b-4663-80c7-436e04b34a16 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.674145 Aug 07 22:30:37.722578 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 8/14] 10.222.0.30 () {64 vars in 1283 bytes} [Sun Aug 7 22:30:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:30:37.728510 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-84442254-6eb7-464c-bdb5-82fd08896b8b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:30:37.816465 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-84442254-6eb7-464c-bdb5-82fd08896b8b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092290 Aug 07 22:30:37.817797 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 7/15] 10.222.0.30 () {64 vars in 1336 bytes} [Sun Aug 7 22:30:37 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:30:40.058521 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-defef230-1c4b-4663-80c7-436e04b34a16 admin admin] Calling method '>' {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:30:40.059964 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-defef230-1c4b-4663-80c7-436e04b34a16 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001962 Aug 07 22:30:40.060643 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 9/16] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 22:30:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:30:40.495445 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-7c9bfc60-d8dd-4439-a88c-f85a197dc405 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds4G", "id": "d4", "swap": 0, "disk": 20, "vcpus": 4, "os-flavor-access:is_public": true}} {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:30:40.573688 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-7c9bfc60-d8dd-4439-a88c-f85a197dc405 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.507231 Aug 07 22:30:40.582825 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 8/17] 10.222.0.30 () {64 vars in 1283 bytes} [Sun Aug 7 22:30:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:30:40.587836 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-e867e828-92fe-4476-81f4-ff802d1cf4b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:30:40.679179 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-e867e828-92fe-4476-81f4-ff802d1cf4b4 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094915 Aug 07 22:30:40.679695 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 10/18] 10.222.0.30 () {64 vars in 1336 bytes} [Sun Aug 7 22:30:40 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:30:43.437134 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-7c9bfc60-d8dd-4439-a88c-f85a197dc405 admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:30:43.438340 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-7c9bfc60-d8dd-4439-a88c-f85a197dc405 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001660 Aug 07 22:30:43.438913 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 9/19] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 22:30:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:30:43.878443 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-c4bb3131-5dc2-45ac-93f6-2ae52bc6f21a admin admin] Calling method '>' {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:30:43.925153 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-c4bb3131-5dc2-45ac-93f6-2ae52bc6f21a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.479243 Aug 07 22:30:43.926171 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1292 bytes} [Sun Aug 7 22:30:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:30:46.177716 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-7c9bfc60-d8dd-4439-a88c-f85a197dc405 admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:30:46.179063 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-7c9bfc60-d8dd-4439-a88c-f85a197dc405 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001949 Aug 07 22:30:46.179612 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 22:30:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:30:46.599023 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-b7294a9b-07ee-4851-b5d2-30137ca1ebfe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "ram": 512, "id": "1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:30:46.706115 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-b7294a9b-07ee-4851-b5d2-30137ca1ebfe admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.518145 Aug 07 22:30:46.706687 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 12/22] 10.222.0.30 () {64 vars in 1283 bytes} [Sun Aug 7 22:30:46 2022] POST /compute/v2.1/flavors => generated 402 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:30:46.722862 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-8de86c8f-fb8a-4f30-a407-c17c0ef5ae3f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:30:46.813644 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-8de86c8f-fb8a-4f30-a407-c17c0ef5ae3f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095710 Aug 07 22:30:46.814464 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 11/23] 10.222.0.30 () {64 vars in 1333 bytes} [Sun Aug 7 22:30:46 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:30:49.021052 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-b7294a9b-07ee-4851-b5d2-30137ca1ebfe admin admin] Calling method '>' {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:30:49.022069 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-b7294a9b-07ee-4851-b5d2-30137ca1ebfe admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 07 22:30:49.022472 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 22:30:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:30:49.422036 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-6ddb6486-6ce4-48c9-98cb-90628b4a5de9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "m1.small", "rxtx_factor": 1.0, "vcpus": 1, "id": "2", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:30:49.498911 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-6ddb6486-6ce4-48c9-98cb-90628b4a5de9 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.470109 Aug 07 22:30:49.499466 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 12/25] 10.222.0.30 () {64 vars in 1283 bytes} [Sun Aug 7 22:30:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:30:49.512087 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-c7fe4eff-8246-415d-bbb1-9c55edb338ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:30:49.599248 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-c7fe4eff-8246-415d-bbb1-9c55edb338ff admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091331 Aug 07 22:30:49.600289 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 14/26] 10.222.0.30 () {64 vars in 1333 bytes} [Sun Aug 7 22:30:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:30:51.832696 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-6ddb6486-6ce4-48c9-98cb-90628b4a5de9 admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:30:51.833691 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-6ddb6486-6ce4-48c9-98cb-90628b4a5de9 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 07 22:30:51.834086 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 22:30:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:30:52.181455 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-c65fd8ea-8718-4136-be9a-00d298e79e48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 40, "id": "3", "swap": 0}} {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:30:52.264639 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-c65fd8ea-8718-4136-be9a-00d298e79e48 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.424694 Aug 07 22:30:52.265200 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 15/28] 10.222.0.30 () {64 vars in 1283 bytes} [Sun Aug 7 22:30:51 2022] POST /compute/v2.1/flavors => generated 406 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:30:52.278024 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-f8e5b04c-bddb-4ee6-aba2-22b938a77284 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:30:52.388188 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-f8e5b04c-bddb-4ee6-aba2-22b938a77284 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114277 Aug 07 22:30:52.388765 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 14/29] 10.222.0.30 () {64 vars in 1333 bytes} [Sun Aug 7 22:30:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:30:54.656385 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-c65fd8ea-8718-4136-be9a-00d298e79e48 admin admin] Calling method '>' {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:30:54.658294 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-c65fd8ea-8718-4136-be9a-00d298e79e48 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002301 Aug 07 22:30:54.659054 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 22:30:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:30:55.115962 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-b80d96a3-32c7-4cd4-8c55-a7fabb32761c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "vcpus": 4, "name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "id": "4", "ram": 8192, "rxtx_factor": 1.0}} {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:30:55.122333 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG dbcounter [-] [103837] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:30:55.198188 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-b80d96a3-32c7-4cd4-8c55-a7fabb32761c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.532571 Aug 07 22:30:55.198778 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 15/31] 10.222.0.30 () {64 vars in 1283 bytes} [Sun Aug 7 22:30:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:30:55.211084 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-4c991b96-fff8-488e-8026-3b8cbef31b5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:30:55.305763 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-4c991b96-fff8-488e-8026-3b8cbef31b5b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098510 Aug 07 22:30:55.306961 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 17/32] 10.222.0.30 () {64 vars in 1333 bytes} [Sun Aug 7 22:30:55 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:30:57.651091 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-b80d96a3-32c7-4cd4-8c55-a7fabb32761c admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:30:57.652207 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-b80d96a3-32c7-4cd4-8c55-a7fabb32761c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 07 22:30:57.652610 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 22:30:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:30:58.109661 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-e26d11c4-6a9b-40b9-8189-4f4bfe86856b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "rxtx_factor": 1.0, "disk": 160, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "5", "os-flavor-access:is_public": true, "name": "m1.xlarge"}} {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:30:58.204173 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-e26d11c4-6a9b-40b9-8189-4f4bfe86856b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.545256 Aug 07 22:30:58.205931 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 18/34] 10.222.0.30 () {64 vars in 1283 bytes} [Sun Aug 7 22:30:57 2022] POST /compute/v2.1/flavors => generated 408 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:30:58.216715 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-48403006-91e3-45fe-a454-0409ab460531 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:30:58.296148 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-48403006-91e3-45fe-a454-0409ab460531 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082908 Aug 07 22:30:58.297024 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 17/35] 10.222.0.30 () {64 vars in 1333 bytes} [Sun Aug 7 22:30:58 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:31:18.122744 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-e26d11c4-6a9b-40b9-8189-4f4bfe86856b admin admin] Calling method '>' {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:31:18.123742 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-e26d11c4-6a9b-40b9-8189-4f4bfe86856b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 07 22:31:18.124175 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 19/36] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 22:31:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:31:18.509336 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-df340fd8-d61b-4c4f-b79f-d17a833e930d admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:31:18.527741 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-df340fd8-d61b-4c4f-b79f-d17a833e930d admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.397501 Aug 07 22:31:18.528293 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1292 bytes} [Sun Aug 7 22:31:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:31:19.587798 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-e26d11c4-6a9b-40b9-8189-4f4bfe86856b admin admin] Calling method '>' {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:31:19.588866 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-e26d11c4-6a9b-40b9-8189-4f4bfe86856b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 07 22:31:19.589250 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1074 bytes} [Sun Aug 7 22:31:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:31:20.108181 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-9b05de25-ece9-43c1-8cf9-eb7609605b30 admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:31:20.113827 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.wsgi [None req-9b05de25-ece9-43c1-8cf9-eb7609605b30 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 07 22:31:20.117454 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-9b05de25-ece9-43c1-8cf9-eb7609605b30 admin admin] Request method failure captured: Aug 07 22:31:20.117454 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 07 22:31:20.117454 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: Accept: application/json Aug 07 22:31:20.117454 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: Accept-Encoding: gzip, deflate Aug 07 22:31:20.117454 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: Connection: keep-alive Aug 07 22:31:20.117454 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: Content-Length: 0 Aug 07 22:31:20.117454 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: Host: 10.222.0.30 Aug 07 22:31:20.117454 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: Openstack-Api-Version: compute 2.90 Aug 07 22:31:20.117454 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: Openstack-System-Scope: None Aug 07 22:31:20.117454 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: User-Agent: python-novaclient Aug 07 22:31:20.117454 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Auth-Token: gAAAAABi8D03MOo8vJZwp66JHnFqdgmoK4GSIqSDofxiIOTDIn24f5lO0yRbhafhqXsx9rb2827Jso1J1AOBCaPzXbN8ayPkqCT91vR7VrxLfmorAtK574zzt5O2sc33zZAOPA04xE-DjDW2HJ2O5lu_UpZ91XpaaCNz6f1-3yrANQg9nqUc61w Aug 07 22:31:20.117454 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Domain-Id: None Aug 07 22:31:20.117454 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Domain-Name: None Aug 07 22:31:20.117454 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Identity-Status: Confirmed Aug 07 22:31:20.117454 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Is-Admin-Project: True Aug 07 22:31:20.117454 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 22:31:20.117454 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Project-Domain-Id: default Aug 07 22:31:20.117454 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Project-Domain-Name: Default Aug 07 22:31:20.117454 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Project-Id: ff949bd3888c436789a339dd0a2e16fc Aug 07 22:31:20.117454 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Project-Name: admin Aug 07 22:31:20.117454 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Role: reader,admin,member Aug 07 22:31:20.117454 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Roles: reader,admin,member Aug 07 22:31:20.119016 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ff949bd3888c436789a339dd0a2e16fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ff949bd3888c436789a339dd0a2e16fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ff949bd3888c436789a339dd0a2e16fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ff949bd3888c436789a339dd0a2e16fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:31:20.119016 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Tenant: admin Aug 07 22:31:20.119016 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Tenant-Id: ff949bd3888c436789a339dd0a2e16fc Aug 07 22:31:20.119016 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Tenant-Name: admin Aug 07 22:31:20.119016 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-User: admin Aug 07 22:31:20.119016 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-User-Domain-Id: default Aug 07 22:31:20.119016 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-User-Domain-Name: Default Aug 07 22:31:20.119016 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-User-Id: 620b714c359944a6b1d8649f781a6815 Aug 07 22:31:20.119016 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-User-Name: admin Aug 07 22:31:20.119016 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: method: > Aug 07 22:31:20.119016 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: exception: Flavor 42 could not be found. Aug 07 22:31:20.119016 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: action_args: {'id': '42'} Aug 07 22:31:20.119016 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:31:20.119016 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:31:20.120358 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 22:31:20.120358 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 22:31:20.120358 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 22:31:20.120358 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 22:31:20.120358 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 22:31:20.120358 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 22:31:20.120358 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 22:31:20.120358 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 22:31:20.120358 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 22:31:20.120358 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:31:20.120358 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 22:31:20.120358 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 22:31:20.120358 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 07 22:31:20.120358 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi Aug 07 22:31:20.120358 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:31:20.120358 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi Aug 07 22:31:20.120358 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:31:20.120358 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:31:20.120358 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:31:20.121657 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:31:20.121657 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:31:20.121657 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:31:20.121657 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:31:20.121657 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 22:31:20.121657 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:31:20.121657 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 07 22:31:20.121657 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi Aug 07 22:31:20.121657 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:31:20.121657 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi Aug 07 22:31:20.121657 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:31:20.121657 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:31:20.121657 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:31:20.121657 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:31:20.121657 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:31:20.121657 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 07 22:31:20.121657 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi Aug 07 22:31:20.121657 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-9b05de25-ece9-43c1-8cf9-eb7609605b30 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:31:20.122777 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-9b05de25-ece9-43c1-8cf9-eb7609605b30 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.393326 Aug 07 22:31:20.122777 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1190 bytes} [Sun Aug 7 22:31:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 22:31:20.128800 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-5fee68c1-0dec-41fe-a7a4-04acd7b0130d admin admin] Calling method '>' {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:31:20.133106 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG dbcounter [-] [103836] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:31:20.151896 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-5fee68c1-0dec-41fe-a7a4-04acd7b0130d admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026970 Aug 07 22:31:20.152459 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1210 bytes} [Sun Aug 7 22:31:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:31:20.162252 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-87829c6e-ed89-4052-9bf4-463ace7dc7cf admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:31:20.187280 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-87829c6e-ed89-4052-9bf4-463ace7dc7cf admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028636 Aug 07 22:31:20.187825 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1210 bytes} [Sun Aug 7 22:31:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:31:20.197145 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-117d14de-6867-4616-b9b7-8dc2dc831e19 admin admin] Calling method '>' {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:31:20.203159 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.wsgi [None req-117d14de-6867-4616-b9b7-8dc2dc831e19 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 07 22:31:20.206406 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-117d14de-6867-4616-b9b7-8dc2dc831e19 admin admin] Request method failure captured: Aug 07 22:31:20.206406 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 07 22:31:20.206406 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: Accept: application/json Aug 07 22:31:20.206406 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: Accept-Encoding: gzip, deflate Aug 07 22:31:20.206406 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: Connection: keep-alive Aug 07 22:31:20.206406 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: Content-Length: 0 Aug 07 22:31:20.206406 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: Host: 10.222.0.30 Aug 07 22:31:20.206406 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: Openstack-Api-Version: compute 2.90 Aug 07 22:31:20.206406 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: Openstack-System-Scope: None Aug 07 22:31:20.206406 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: User-Agent: python-novaclient Aug 07 22:31:20.206406 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Auth-Token: gAAAAABi8D03MOo8vJZwp66JHnFqdgmoK4GSIqSDofxiIOTDIn24f5lO0yRbhafhqXsx9rb2827Jso1J1AOBCaPzXbN8ayPkqCT91vR7VrxLfmorAtK574zzt5O2sc33zZAOPA04xE-DjDW2HJ2O5lu_UpZ91XpaaCNz6f1-3yrANQg9nqUc61w Aug 07 22:31:20.206406 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Domain-Id: None Aug 07 22:31:20.206406 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Domain-Name: None Aug 07 22:31:20.206406 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Identity-Status: Confirmed Aug 07 22:31:20.206406 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Is-Admin-Project: True Aug 07 22:31:20.206406 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 22:31:20.206406 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Project-Domain-Id: default Aug 07 22:31:20.206406 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Project-Domain-Name: Default Aug 07 22:31:20.206406 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Project-Id: ff949bd3888c436789a339dd0a2e16fc Aug 07 22:31:20.206406 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Project-Name: admin Aug 07 22:31:20.206406 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Role: reader,admin,member Aug 07 22:31:20.206406 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Roles: reader,admin,member Aug 07 22:31:20.207929 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ff949bd3888c436789a339dd0a2e16fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ff949bd3888c436789a339dd0a2e16fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ff949bd3888c436789a339dd0a2e16fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ff949bd3888c436789a339dd0a2e16fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:31:20.207929 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Tenant: admin Aug 07 22:31:20.207929 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Tenant-Id: ff949bd3888c436789a339dd0a2e16fc Aug 07 22:31:20.207929 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Tenant-Name: admin Aug 07 22:31:20.207929 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-User: admin Aug 07 22:31:20.207929 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-User-Domain-Id: default Aug 07 22:31:20.207929 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-User-Domain-Name: Default Aug 07 22:31:20.207929 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-User-Id: 620b714c359944a6b1d8649f781a6815 Aug 07 22:31:20.207929 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-User-Name: admin Aug 07 22:31:20.207929 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: method: > Aug 07 22:31:20.207929 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: exception: Flavor 42 could not be found. Aug 07 22:31:20.207929 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: action_args: {'id': '42'} Aug 07 22:31:20.207929 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:31:20.207929 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:31:20.212750 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 22:31:20.212750 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 22:31:20.212750 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 22:31:20.212750 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 22:31:20.212750 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 22:31:20.212750 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 22:31:20.212750 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 22:31:20.212750 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 22:31:20.212750 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 22:31:20.212750 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:31:20.212750 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 22:31:20.212750 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 22:31:20.212750 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 07 22:31:20.212750 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi Aug 07 22:31:20.212750 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:31:20.212750 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi Aug 07 22:31:20.212750 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:31:20.212750 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:31:20.212750 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:31:20.214071 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:31:20.214071 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:31:20.214071 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:31:20.214071 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:31:20.214071 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 22:31:20.214071 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:31:20.214071 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 07 22:31:20.214071 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi Aug 07 22:31:20.214071 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:31:20.214071 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi Aug 07 22:31:20.214071 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:31:20.214071 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:31:20.214071 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:31:20.214071 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:31:20.214071 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:31:20.214071 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 07 22:31:20.214071 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi Aug 07 22:31:20.214071 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-117d14de-6867-4616-b9b7-8dc2dc831e19 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:31:20.215264 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-117d14de-6867-4616-b9b7-8dc2dc831e19 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014242 Aug 07 22:31:20.215264 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1190 bytes} [Sun Aug 7 22:31:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 07 22:31:21.175415 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-87829c6e-ed89-4052-9bf4-463ace7dc7cf admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:31:21.176493 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-87829c6e-ed89-4052-9bf4-463ace7dc7cf admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Aug 07 22:31:21.176910 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1074 bytes} [Sun Aug 7 22:31:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:31:21.696526 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-d9750228-bab0-49bd-aaab-b07597f7f706 admin admin] Calling method '>' {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:31:21.702349 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.wsgi [None req-d9750228-bab0-49bd-aaab-b07597f7f706 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 07 22:31:21.703845 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-d9750228-bab0-49bd-aaab-b07597f7f706 admin admin] Request method failure captured: Aug 07 22:31:21.703845 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 07 22:31:21.703845 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: Accept: application/json Aug 07 22:31:21.703845 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: Accept-Encoding: gzip, deflate Aug 07 22:31:21.703845 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: Connection: keep-alive Aug 07 22:31:21.703845 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: Content-Length: 0 Aug 07 22:31:21.703845 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: Host: 10.222.0.30 Aug 07 22:31:21.703845 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: Openstack-Api-Version: compute 2.90 Aug 07 22:31:21.703845 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: Openstack-System-Scope: None Aug 07 22:31:21.703845 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: User-Agent: python-novaclient Aug 07 22:31:21.703845 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Auth-Token: gAAAAABi8D05y9zCZjE1DUVF1O66drVjR4SAVpxCStJCj9hutk1auMV14UWzS4oz4JFe4_Rs7rEJxRb9OWW7oh9LgQCXitqvvRmk_Lw_ILhZN-_R3IKcM4tfC__tuseWIYpdM9s-VZ8ulL91vGs5bxcbU3lEZwCO5Uz3BV0YncbicVxmwnGdtiI Aug 07 22:31:21.703845 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Domain-Id: None Aug 07 22:31:21.703845 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Domain-Name: None Aug 07 22:31:21.703845 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Identity-Status: Confirmed Aug 07 22:31:21.703845 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Is-Admin-Project: True Aug 07 22:31:21.703845 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 22:31:21.703845 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Project-Domain-Id: default Aug 07 22:31:21.703845 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Project-Domain-Name: Default Aug 07 22:31:21.703845 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Project-Id: ff949bd3888c436789a339dd0a2e16fc Aug 07 22:31:21.703845 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Project-Name: admin Aug 07 22:31:21.703845 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Role: reader,admin,member Aug 07 22:31:21.703845 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Roles: reader,admin,member Aug 07 22:31:21.705369 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ff949bd3888c436789a339dd0a2e16fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ff949bd3888c436789a339dd0a2e16fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ff949bd3888c436789a339dd0a2e16fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ff949bd3888c436789a339dd0a2e16fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:31:21.705369 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Tenant: admin Aug 07 22:31:21.705369 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Tenant-Id: ff949bd3888c436789a339dd0a2e16fc Aug 07 22:31:21.705369 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Tenant-Name: admin Aug 07 22:31:21.705369 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-User: admin Aug 07 22:31:21.705369 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-User-Domain-Id: default Aug 07 22:31:21.705369 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-User-Domain-Name: Default Aug 07 22:31:21.705369 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-User-Id: 620b714c359944a6b1d8649f781a6815 Aug 07 22:31:21.705369 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-User-Name: admin Aug 07 22:31:21.705369 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: method: > Aug 07 22:31:21.705369 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: exception: Flavor 84 could not be found. Aug 07 22:31:21.705369 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: action_args: {'id': '84'} Aug 07 22:31:21.705369 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:31:21.705369 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:31:21.706370 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 22:31:21.706370 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 22:31:21.706370 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 22:31:21.706370 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 22:31:21.706370 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 22:31:21.706370 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 22:31:21.706370 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 22:31:21.706370 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 22:31:21.706370 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 22:31:21.706370 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:31:21.706370 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 22:31:21.706370 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 22:31:21.706370 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 07 22:31:21.706370 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi Aug 07 22:31:21.706370 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:31:21.706370 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi Aug 07 22:31:21.706370 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:31:21.706370 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:31:21.706370 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:31:21.707639 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:31:21.707639 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:31:21.707639 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:31:21.707639 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:31:21.707639 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 22:31:21.707639 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:31:21.707639 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 07 22:31:21.707639 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi Aug 07 22:31:21.707639 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:31:21.707639 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi Aug 07 22:31:21.707639 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:31:21.707639 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:31:21.707639 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:31:21.707639 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:31:21.707639 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:31:21.707639 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 07 22:31:21.707639 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi Aug 07 22:31:21.707639 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-d9750228-bab0-49bd-aaab-b07597f7f706 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:31:21.708882 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-d9750228-bab0-49bd-aaab-b07597f7f706 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.390421 Aug 07 22:31:21.708882 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1190 bytes} [Sun Aug 7 22:31:21 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 22:31:21.715697 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-30e21878-be08-4f2b-8ad4-059fff333ccf admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:31:21.730343 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-30e21878-be08-4f2b-8ad4-059fff333ccf admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018895 Aug 07 22:31:21.730895 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1210 bytes} [Sun Aug 7 22:31:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:31:21.740143 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-6cd2ca23-6788-4853-bc49-31a001b56313 admin admin] Calling method '>' {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:31:21.755605 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-6cd2ca23-6788-4853-bc49-31a001b56313 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018918 Aug 07 22:31:21.756133 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1210 bytes} [Sun Aug 7 22:31:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:31:21.765913 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-0d78894a-0a0a-4735-b543-29b78b135c07 admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:31:21.771071 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.wsgi [None req-0d78894a-0a0a-4735-b543-29b78b135c07 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 07 22:31:21.772598 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-0d78894a-0a0a-4735-b543-29b78b135c07 admin admin] Request method failure captured: Aug 07 22:31:21.772598 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 07 22:31:21.772598 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: Accept: application/json Aug 07 22:31:21.772598 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: Accept-Encoding: gzip, deflate Aug 07 22:31:21.772598 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: Connection: keep-alive Aug 07 22:31:21.772598 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: Content-Length: 0 Aug 07 22:31:21.772598 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: Host: 10.222.0.30 Aug 07 22:31:21.772598 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: Openstack-Api-Version: compute 2.90 Aug 07 22:31:21.772598 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: Openstack-System-Scope: None Aug 07 22:31:21.772598 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: User-Agent: python-novaclient Aug 07 22:31:21.772598 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Auth-Token: gAAAAABi8D05y9zCZjE1DUVF1O66drVjR4SAVpxCStJCj9hutk1auMV14UWzS4oz4JFe4_Rs7rEJxRb9OWW7oh9LgQCXitqvvRmk_Lw_ILhZN-_R3IKcM4tfC__tuseWIYpdM9s-VZ8ulL91vGs5bxcbU3lEZwCO5Uz3BV0YncbicVxmwnGdtiI Aug 07 22:31:21.772598 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Domain-Id: None Aug 07 22:31:21.772598 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Domain-Name: None Aug 07 22:31:21.772598 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Identity-Status: Confirmed Aug 07 22:31:21.772598 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Is-Admin-Project: True Aug 07 22:31:21.772598 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 22:31:21.772598 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Project-Domain-Id: default Aug 07 22:31:21.772598 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Project-Domain-Name: Default Aug 07 22:31:21.772598 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Project-Id: ff949bd3888c436789a339dd0a2e16fc Aug 07 22:31:21.772598 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Project-Name: admin Aug 07 22:31:21.772598 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Role: reader,admin,member Aug 07 22:31:21.772598 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Roles: reader,admin,member Aug 07 22:31:21.774077 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ff949bd3888c436789a339dd0a2e16fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ff949bd3888c436789a339dd0a2e16fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ff949bd3888c436789a339dd0a2e16fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ff949bd3888c436789a339dd0a2e16fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:31:21.774077 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Tenant: admin Aug 07 22:31:21.774077 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Tenant-Id: ff949bd3888c436789a339dd0a2e16fc Aug 07 22:31:21.774077 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Tenant-Name: admin Aug 07 22:31:21.774077 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-User: admin Aug 07 22:31:21.774077 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-User-Domain-Id: default Aug 07 22:31:21.774077 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-User-Domain-Name: Default Aug 07 22:31:21.774077 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-User-Id: 620b714c359944a6b1d8649f781a6815 Aug 07 22:31:21.774077 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-User-Name: admin Aug 07 22:31:21.774077 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: method: > Aug 07 22:31:21.774077 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: exception: Flavor 84 could not be found. Aug 07 22:31:21.774077 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: action_args: {'id': '84'} Aug 07 22:31:21.774077 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:31:21.774077 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:31:21.775104 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 22:31:21.775104 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 22:31:21.775104 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 22:31:21.775104 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 22:31:21.775104 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 22:31:21.775104 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 22:31:21.775104 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 22:31:21.775104 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 22:31:21.775104 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 22:31:21.775104 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:31:21.775104 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 22:31:21.775104 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 22:31:21.775104 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 07 22:31:21.775104 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi Aug 07 22:31:21.775104 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:31:21.775104 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi Aug 07 22:31:21.775104 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:31:21.775104 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:31:21.775104 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:31:21.776310 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:31:21.776310 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:31:21.776310 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:31:21.776310 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:31:21.776310 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 22:31:21.776310 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:31:21.776310 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 07 22:31:21.776310 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi Aug 07 22:31:21.776310 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:31:21.776310 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi Aug 07 22:31:21.776310 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:31:21.776310 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:31:21.776310 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:31:21.776310 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:31:21.776310 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:31:21.776310 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 07 22:31:21.776310 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi Aug 07 22:31:21.776310 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-0d78894a-0a0a-4735-b543-29b78b135c07 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:31:21.777336 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-0d78894a-0a0a-4735-b543-29b78b135c07 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011477 Aug 07 22:31:21.777336 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1190 bytes} [Sun Aug 7 22:31:21 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 22:31:22.753711 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-6cd2ca23-6788-4853-bc49-31a001b56313 admin admin] Calling method '>' {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:31:22.754735 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-6cd2ca23-6788-4853-bc49-31a001b56313 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 07 22:31:22.755131 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1074 bytes} [Sun Aug 7 22:31:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:31:23.271719 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-10ead428-3438-4f38-96e0-7ac9ca600a5e admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:31:23.277518 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.wsgi [None req-10ead428-3438-4f38-96e0-7ac9ca600a5e admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 07 22:31:23.278991 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-10ead428-3438-4f38-96e0-7ac9ca600a5e admin admin] Request method failure captured: Aug 07 22:31:23.278991 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 07 22:31:23.278991 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: Accept: application/json Aug 07 22:31:23.278991 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: Accept-Encoding: gzip, deflate Aug 07 22:31:23.278991 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: Connection: keep-alive Aug 07 22:31:23.278991 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: Content-Length: 0 Aug 07 22:31:23.278991 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: Host: 10.222.0.30 Aug 07 22:31:23.278991 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: Openstack-Api-Version: compute 2.90 Aug 07 22:31:23.278991 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: Openstack-System-Scope: None Aug 07 22:31:23.278991 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: User-Agent: python-novaclient Aug 07 22:31:23.278991 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Auth-Token: gAAAAABi8D06qYT56dmCH6U6qZNr2WVzQQFd7GxvfEVJL1mwl913aWdlDWGEbuUS80Uill-dXe3LKYdNXX7-Bl-QS3zuO4nTUE0BCD6rDgBqxqhAj1K69B5Sr-5pUIq_Fa1qVrfilKbXrwz0ETl6o1gQmyrVnOkfPaoX2P_Or6tsa8AwkPzxE_Y Aug 07 22:31:23.278991 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Domain-Id: None Aug 07 22:31:23.278991 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Domain-Name: None Aug 07 22:31:23.278991 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Identity-Status: Confirmed Aug 07 22:31:23.278991 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Is-Admin-Project: True Aug 07 22:31:23.278991 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 22:31:23.278991 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Project-Domain-Id: default Aug 07 22:31:23.278991 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Project-Domain-Name: Default Aug 07 22:31:23.278991 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Project-Id: ff949bd3888c436789a339dd0a2e16fc Aug 07 22:31:23.278991 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Project-Name: admin Aug 07 22:31:23.278991 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Role: reader,admin,member Aug 07 22:31:23.278991 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Roles: reader,admin,member Aug 07 22:31:23.280353 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ff949bd3888c436789a339dd0a2e16fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ff949bd3888c436789a339dd0a2e16fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ff949bd3888c436789a339dd0a2e16fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ff949bd3888c436789a339dd0a2e16fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:31:23.280353 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Tenant: admin Aug 07 22:31:23.280353 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Tenant-Id: ff949bd3888c436789a339dd0a2e16fc Aug 07 22:31:23.280353 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-Tenant-Name: admin Aug 07 22:31:23.280353 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-User: admin Aug 07 22:31:23.280353 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-User-Domain-Id: default Aug 07 22:31:23.280353 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-User-Domain-Name: Default Aug 07 22:31:23.280353 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-User-Id: 620b714c359944a6b1d8649f781a6815 Aug 07 22:31:23.280353 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: X-User-Name: admin Aug 07 22:31:23.280353 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: method: > Aug 07 22:31:23.280353 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: exception: Flavor 451 could not be found. Aug 07 22:31:23.280353 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: action_args: {'id': '451'} Aug 07 22:31:23.280353 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:31:23.280353 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:31:23.281371 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 22:31:23.281371 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 22:31:23.281371 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 22:31:23.281371 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 22:31:23.281371 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 22:31:23.281371 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 22:31:23.281371 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 22:31:23.281371 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 22:31:23.281371 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 22:31:23.281371 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:31:23.281371 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 22:31:23.281371 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 22:31:23.281371 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 07 22:31:23.281371 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi Aug 07 22:31:23.281371 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:31:23.281371 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi Aug 07 22:31:23.281371 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:31:23.281371 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:31:23.281371 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:31:23.282713 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:31:23.282713 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:31:23.282713 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:31:23.282713 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:31:23.282713 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 22:31:23.282713 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:31:23.282713 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 07 22:31:23.282713 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi Aug 07 22:31:23.282713 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:31:23.282713 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi Aug 07 22:31:23.282713 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:31:23.282713 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:31:23.282713 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:31:23.282713 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:31:23.282713 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:31:23.282713 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 07 22:31:23.282713 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: ERROR nova.api.openstack.wsgi Aug 07 22:31:23.282713 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-10ead428-3438-4f38-96e0-7ac9ca600a5e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:31:23.283909 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-10ead428-3438-4f38-96e0-7ac9ca600a5e admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.386885 Aug 07 22:31:23.283909 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 24/49] 10.222.0.30 () {60 vars in 1193 bytes} [Sun Aug 7 22:31:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 22:31:23.290132 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-b74c47f0-34bb-4cc1-b6a0-39b4a02368b0 admin admin] Calling method '>' {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:31:23.305000 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-b74c47f0-34bb-4cc1-b6a0-39b4a02368b0 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018524 Aug 07 22:31:23.305533 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 26/50] 10.222.0.30 () {60 vars in 1210 bytes} [Sun Aug 7 22:31:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:31:23.315272 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-c0d5dc13-c312-46f8-b69a-edce99d0acbf admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:31:23.330418 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-c0d5dc13-c312-46f8-b69a-edce99d0acbf admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018638 Aug 07 22:31:23.330929 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1210 bytes} [Sun Aug 7 22:31:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:31:23.340329 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-f985ec29-4c76-4974-b253-1f9e621b1571 admin admin] Calling method '>' {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:31:23.345570 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.wsgi [None req-f985ec29-4c76-4974-b253-1f9e621b1571 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 07 22:31:23.347052 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-f985ec29-4c76-4974-b253-1f9e621b1571 admin admin] Request method failure captured: Aug 07 22:31:23.347052 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 07 22:31:23.347052 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: Accept: application/json Aug 07 22:31:23.347052 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: Accept-Encoding: gzip, deflate Aug 07 22:31:23.347052 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: Connection: keep-alive Aug 07 22:31:23.347052 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: Content-Length: 0 Aug 07 22:31:23.347052 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: Host: 10.222.0.30 Aug 07 22:31:23.347052 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: Openstack-Api-Version: compute 2.90 Aug 07 22:31:23.347052 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: Openstack-System-Scope: None Aug 07 22:31:23.347052 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: User-Agent: python-novaclient Aug 07 22:31:23.347052 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Auth-Token: gAAAAABi8D06qYT56dmCH6U6qZNr2WVzQQFd7GxvfEVJL1mwl913aWdlDWGEbuUS80Uill-dXe3LKYdNXX7-Bl-QS3zuO4nTUE0BCD6rDgBqxqhAj1K69B5Sr-5pUIq_Fa1qVrfilKbXrwz0ETl6o1gQmyrVnOkfPaoX2P_Or6tsa8AwkPzxE_Y Aug 07 22:31:23.347052 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Domain-Id: None Aug 07 22:31:23.347052 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Domain-Name: None Aug 07 22:31:23.347052 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Identity-Status: Confirmed Aug 07 22:31:23.347052 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Is-Admin-Project: True Aug 07 22:31:23.347052 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 22:31:23.347052 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Project-Domain-Id: default Aug 07 22:31:23.347052 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Project-Domain-Name: Default Aug 07 22:31:23.347052 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Project-Id: ff949bd3888c436789a339dd0a2e16fc Aug 07 22:31:23.347052 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Project-Name: admin Aug 07 22:31:23.347052 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Role: reader,admin,member Aug 07 22:31:23.347052 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Roles: reader,admin,member Aug 07 22:31:23.348780 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ff949bd3888c436789a339dd0a2e16fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ff949bd3888c436789a339dd0a2e16fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ff949bd3888c436789a339dd0a2e16fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ff949bd3888c436789a339dd0a2e16fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:31:23.348780 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Tenant: admin Aug 07 22:31:23.348780 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Tenant-Id: ff949bd3888c436789a339dd0a2e16fc Aug 07 22:31:23.348780 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-Tenant-Name: admin Aug 07 22:31:23.348780 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-User: admin Aug 07 22:31:23.348780 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-User-Domain-Id: default Aug 07 22:31:23.348780 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-User-Domain-Name: Default Aug 07 22:31:23.348780 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-User-Id: 620b714c359944a6b1d8649f781a6815 Aug 07 22:31:23.348780 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: X-User-Name: admin Aug 07 22:31:23.348780 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: method: > Aug 07 22:31:23.348780 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: exception: Flavor 451 could not be found. Aug 07 22:31:23.348780 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: action_args: {'id': '451'} Aug 07 22:31:23.348780 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:31:23.348780 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:31:23.349904 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 22:31:23.349904 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 22:31:23.349904 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 22:31:23.349904 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 22:31:23.349904 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 22:31:23.349904 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 22:31:23.349904 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 22:31:23.349904 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 22:31:23.349904 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 22:31:23.349904 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:31:23.349904 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 22:31:23.349904 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 22:31:23.349904 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 07 22:31:23.349904 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi Aug 07 22:31:23.349904 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:31:23.349904 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi Aug 07 22:31:23.349904 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:31:23.349904 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:31:23.349904 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:31:23.351185 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:31:23.351185 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:31:23.351185 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:31:23.351185 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:31:23.351185 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 22:31:23.351185 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:31:23.351185 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 07 22:31:23.351185 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi Aug 07 22:31:23.351185 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:31:23.351185 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi Aug 07 22:31:23.351185 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:31:23.351185 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:31:23.351185 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:31:23.351185 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:31:23.351185 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:31:23.351185 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 07 22:31:23.351185 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: ERROR nova.api.openstack.wsgi Aug 07 22:31:23.351185 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-f985ec29-4c76-4974-b253-1f9e621b1571 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:31:23.352811 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-f985ec29-4c76-4974-b253-1f9e621b1571 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011830 Aug 07 22:31:23.352811 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1193 bytes} [Sun Aug 7 22:31:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 22:31:24.315228 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-c0d5dc13-c312-46f8-b69a-edce99d0acbf admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:31:24.316278 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-c0d5dc13-c312-46f8-b69a-edce99d0acbf admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 07 22:31:24.316675 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1074 bytes} [Sun Aug 7 22:31:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:31:24.841381 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-d0c69faa-fcdd-4072-86db-e78242ff1a45 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:31:24.931392 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-d0c69faa-fcdd-4072-86db-e78242ff1a45 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.476241 Aug 07 22:31:24.931942 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 28/54] 10.222.0.30 () {64 vars in 1235 bytes} [Sun Aug 7 22:31:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:31:25.898778 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-c0d5dc13-c312-46f8-b69a-edce99d0acbf admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:31:25.899797 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-c0d5dc13-c312-46f8-b69a-edce99d0acbf admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 07 22:31:25.900222 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1074 bytes} [Sun Aug 7 22:31:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:31:26.422954 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-b232eab7-5b4d-49a1-b4cf-13b9c458e376 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:31:26.481032 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-b232eab7-5b4d-49a1-b4cf-13b9c458e376 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.442315 Aug 07 22:31:26.481583 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 29/56] 10.222.0.30 () {64 vars in 1235 bytes} [Sun Aug 7 22:31:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:31:27.442710 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-c0d5dc13-c312-46f8-b69a-edce99d0acbf admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:31:27.443695 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-c0d5dc13-c312-46f8-b69a-edce99d0acbf admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Aug 07 22:31:27.444114 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1074 bytes} [Sun Aug 7 22:31:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:31:27.959533 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-d31cd175-66e0-4fb0-ac50-c24eafee76ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:31:28.038311 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-d31cd175-66e0-4fb0-ac50-c24eafee76ed admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.458468 Aug 07 22:31:28.038851 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1235 bytes} [Sun Aug 7 22:31:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:31:28.993690 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-c0d5dc13-c312-46f8-b69a-edce99d0acbf admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:31:28.995348 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-c0d5dc13-c312-46f8-b69a-edce99d0acbf admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Aug 07 22:31:28.995769 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1074 bytes} [Sun Aug 7 22:31:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:31:29.517176 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-54d5c411-cdd9-427b-8883-487b53062e54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:31:29.594471 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-54d5c411-cdd9-427b-8883-487b53062e54 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.462951 Aug 07 22:31:29.595046 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 31/60] 10.222.0.30 () {64 vars in 1235 bytes} [Sun Aug 7 22:31:29 2022] POST /compute/v2.1/flavors => generated 409 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:31:30.565338 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-c0d5dc13-c312-46f8-b69a-edce99d0acbf admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:31:30.566377 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-c0d5dc13-c312-46f8-b69a-edce99d0acbf admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 07 22:31:30.566776 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 30/61] 10.222.0.30 () {56 vars in 1074 bytes} [Sun Aug 7 22:31:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:31:31.084518 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-df6d5c0a-d8b7-45a8-bf6e-5b264b1133d9 admin admin] Calling method '>' {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:31:31.105136 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-df6d5c0a-d8b7-45a8-bf6e-5b264b1133d9 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.400221 Aug 07 22:31:31.105674 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1202 bytes} [Sun Aug 7 22:31:30 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:32:22.382299 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-c0d5dc13-c312-46f8-b69a-edce99d0acbf admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:32:22.383321 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-c0d5dc13-c312-46f8-b69a-edce99d0acbf admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001713 Aug 07 22:32:22.383737 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 22:32:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:32:22.395127 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG dbcounter [-] [103836] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:32:22.772210 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-cab4ebc4-1709-4c43-b8f7-72bd6ce2a938 admin admin] Calling method '>' {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:32:22.792540 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-cab4ebc4-1709-4c43-b8f7-72bd6ce2a938 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.401929 Aug 07 22:32:22.793081 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1292 bytes} [Sun Aug 7 22:32:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:32:22.816339 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-dd993be1-9cf5-4ad4-80a6-7d0f5cfc0b93 admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:32:22.819641 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG dbcounter [-] [103837] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:32:22.824820 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-dd993be1-9cf5-4ad4-80a6-7d0f5cfc0b93 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012061 Aug 07 22:32:22.825302 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1283 bytes} [Sun Aug 7 22:32:22 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:32:22.836579 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-85e2a46a-6596-4b90-be13-d9339a2f6a8c admin admin] Calling method '>' {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:32:22.844597 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-85e2a46a-6596-4b90-be13-d9339a2f6a8c admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011596 Aug 07 22:32:22.845113 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1286 bytes} [Sun Aug 7 22:32:22 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:32:22.856672 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-742863ab-0f64-423f-ad80-6ca1de1e9b6d admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:32:22.864324 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-742863ab-0f64-423f-ad80-6ca1de1e9b6d admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011313 Aug 07 22:32:22.864833 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1286 bytes} [Sun Aug 7 22:32:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:32:22.876130 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-e74895e2-5f91-4b04-a5cc-b426aebddd72 admin admin] Calling method '>' {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:32:22.883849 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-e74895e2-5f91-4b04-a5cc-b426aebddd72 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011244 Aug 07 22:32:22.884396 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1283 bytes} [Sun Aug 7 22:32:22 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:35:23.582318 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-742863ab-0f64-423f-ad80-6ca1de1e9b6d admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:35:23.583316 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-742863ab-0f64-423f-ad80-6ca1de1e9b6d admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 07 22:35:23.583699 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 34/69] 10.222.0.30 () {56 vars in 1074 bytes} [Sun Aug 7 22:35:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:35:23.730361 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG dbcounter [-] [103836] Writing DB stats nova_api:SELECT=6 {{(pid=103836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:35:23.891433 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-5e64806b-4ba6-4a19-9f06-d42451205460 admin admin] Calling method '>' {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:35:23.893806 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 22:35:23.893806 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: warnings.warn(msg) Aug 07 22:35:23.895084 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-5e64806b-4ba6-4a19-9f06-d42451205460 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:35:23.895577 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-5e64806b-4ba6-4a19-9f06-d42451205460 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:35:23.895993 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-5e64806b-4ba6-4a19-9f06-d42451205460 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:35:23.896721 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-5e64806b-4ba6-4a19-9f06-d42451205460 admin admin] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:35:23.897145 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-5e64806b-4ba6-4a19-9f06-d42451205460 admin admin] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:35:23.897551 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-5e64806b-4ba6-4a19-9f06-d42451205460 admin admin] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:35:23.931050 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-5e64806b-4ba6-4a19-9f06-d42451205460 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.202306 Aug 07 22:35:23.931755 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 36/70] 10.222.0.30 () {60 vars in 1193 bytes} [Sun Aug 7 22:35:23 2022] GET /compute/v2.1/os-services => generated 791 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:35:24.769155 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-742863ab-0f64-423f-ad80-6ca1de1e9b6d admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:35:24.770151 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-742863ab-0f64-423f-ad80-6ca1de1e9b6d admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Aug 07 22:35:24.770536 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 35/71] 10.222.0.30 () {56 vars in 1074 bytes} [Sun Aug 7 22:35:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:35:24.961072 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-8adf7919-cbc3-4df4-bd4b-c1518726b9cb admin admin] Calling method '>' {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:35:24.964305 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 22:35:24.964305 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: warnings.warn(msg) Aug 07 22:35:24.970169 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-8adf7919-cbc3-4df4-bd4b-c1518726b9cb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:35:24.970169 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-8adf7919-cbc3-4df4-bd4b-c1518726b9cb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:35:24.970169 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-8adf7919-cbc3-4df4-bd4b-c1518726b9cb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:35:24.970169 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-8adf7919-cbc3-4df4-bd4b-c1518726b9cb admin admin] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:35:24.970169 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-8adf7919-cbc3-4df4-bd4b-c1518726b9cb admin admin] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:35:24.970635 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-8adf7919-cbc3-4df4-bd4b-c1518726b9cb admin admin] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:35:24.988389 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-8adf7919-cbc3-4df4-bd4b-c1518726b9cb admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080592 Aug 07 22:35:24.988890 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 37/72] 10.222.0.30 () {60 vars in 1193 bytes} [Sun Aug 7 22:35:24 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 22:35:36.228743 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-742863ab-0f64-423f-ad80-6ca1de1e9b6d admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:35:36.229742 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-742863ab-0f64-423f-ad80-6ca1de1e9b6d admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001742 Aug 07 22:35:36.230150 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 36/73] 10.222.0.30 () {56 vars in 1074 bytes} [Sun Aug 7 22:35:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:35:36.371842 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG dbcounter [-] [103836] Writing DB stats nova_cell0:SELECT=4 {{(pid=103836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:35:36.372589 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG dbcounter [-] [103836] Writing DB stats nova_cell1:SELECT=4 {{(pid=103836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:35:36.373197 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG dbcounter [-] [103836] Writing DB stats nova_api:SELECT=8 {{(pid=103836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:35:36.421557 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-920a399c-0df6-4407-8001-e6cdc8e8b531 admin admin] Calling method '>' {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:35:36.423945 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 22:35:36.423945 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: warnings.warn(msg) Aug 07 22:35:36.425072 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-920a399c-0df6-4407-8001-e6cdc8e8b531 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:35:36.425586 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-920a399c-0df6-4407-8001-e6cdc8e8b531 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:35:36.425993 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-920a399c-0df6-4407-8001-e6cdc8e8b531 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:35:36.426690 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-920a399c-0df6-4407-8001-e6cdc8e8b531 admin admin] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:35:36.427132 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-920a399c-0df6-4407-8001-e6cdc8e8b531 admin admin] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:35:36.427539 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-920a399c-0df6-4407-8001-e6cdc8e8b531 admin admin] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:35:36.454218 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-920a399c-0df6-4407-8001-e6cdc8e8b531 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087592 Aug 07 22:35:36.454700 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 38/74] 10.222.0.30 () {60 vars in 1193 bytes} [Sun Aug 7 22:35:36 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:35:37.275053 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: DEBUG nova.api.openstack.wsgi [None req-742863ab-0f64-423f-ad80-6ca1de1e9b6d admin admin] Calling method '>' {{(pid=103837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:35:37.276088 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: INFO nova.api.openstack.requestlog [None req-742863ab-0f64-423f-ad80-6ca1de1e9b6d admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001920 Aug 07 22:35:37.276482 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: [pid: 103837|app: 0|req: 37/75] 10.222.0.30 () {56 vars in 1074 bytes} [Sun Aug 7 22:35:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:35:37.465677 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG nova.api.openstack.wsgi [None req-b1ef5aaf-424e-40d5-8c49-1dc7cfa7718e admin admin] Calling method '>' {{(pid=103836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:35:37.468072 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 22:35:37.468072 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: warnings.warn(msg) Aug 07 22:35:37.469155 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-b1ef5aaf-424e-40d5-8c49-1dc7cfa7718e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:35:37.469620 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-b1ef5aaf-424e-40d5-8c49-1dc7cfa7718e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:35:37.470069 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-b1ef5aaf-424e-40d5-8c49-1dc7cfa7718e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:35:37.470780 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-b1ef5aaf-424e-40d5-8c49-1dc7cfa7718e admin admin] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:35:37.471217 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-b1ef5aaf-424e-40d5-8c49-1dc7cfa7718e admin admin] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:35:37.471625 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: DEBUG oslo_concurrency.lockutils [None req-b1ef5aaf-424e-40d5-8c49-1dc7cfa7718e admin admin] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:35:37.492983 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: INFO nova.api.openstack.requestlog [None req-b1ef5aaf-424e-40d5-8c49-1dc7cfa7718e admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078590 Aug 07 22:35:37.494032 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: [pid: 103836|app: 0|req: 39/76] 10.222.0.30 () {60 vars in 1193 bytes} [Sun Aug 7 22:35:37 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:36:34.790363 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: Sun Aug 7 22:36:34 2022 - graceful shutdown triggered... Aug 07 22:36:34.790848 dv-cinder-850321-3-iscsi devstack@n-api.service[103836]: Gracefully killing worker 1 (pid: 103836)... Aug 07 22:36:34.790533 dv-cinder-850321-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 07 22:36:34.791681 dv-cinder-850321-3-iscsi devstack@n-api.service[103837]: Gracefully killing worker 2 (pid: 103837)... Aug 07 22:36:35.791449 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: worker 1 buried after 1 seconds Aug 07 22:36:35.792040 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: worker 2 buried after 1 seconds Aug 07 22:36:35.792040 dv-cinder-850321-3-iscsi devstack@n-api.service[103835]: goodbye to uWSGI. Aug 07 22:36:35.793068 dv-cinder-850321-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 07 22:36:35.793612 dv-cinder-850321-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 07 22:36:35.796444 dv-cinder-850321-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 07 22:36:35.807015 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 07 22:36:35.809630 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 7 22:36:35 2022] *** Aug 07 22:36:35.809790 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 07 22:36:35.809922 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 07 22:36:35.810051 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: nodename: dv-cinder-850321-3-iscsi Aug 07 22:36:35.810173 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: machine: x86_64 Aug 07 22:36:35.810283 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: clock source: unix Aug 07 22:36:35.810401 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: pcre jit disabled Aug 07 22:36:35.810525 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: detected number of CPU cores: 4 Aug 07 22:36:35.810525 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: current working directory: / Aug 07 22:36:35.810525 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: detected binary path: /usr/bin/uwsgi-core Aug 07 22:36:35.810525 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: your processes number limit is 47680 Aug 07 22:36:35.810525 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: your memory page size is 4096 bytes Aug 07 22:36:35.810525 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: detected max file descriptor number: 2048 Aug 07 22:36:35.810525 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: lock engine: pthread robust mutexes Aug 07 22:36:35.811112 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: thunder lock: enabled Aug 07 22:36:35.811112 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 07 22:36:35.811112 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 07 22:36:35.850023 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: Python main interpreter initialized at 0x558768f7a9c0 Aug 07 22:36:35.850023 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: python threads support enabled Aug 07 22:36:35.850023 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: your server socket listen backlog is limited to 100 connections Aug 07 22:36:35.850023 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: your mercy for graceful operations on workers is 90 seconds Aug 07 22:36:35.850474 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: mapped 403077 bytes (393 KB) for 2 cores Aug 07 22:36:35.850474 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: *** Operational MODE: preforking *** Aug 07 22:36:35.850761 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: *** uWSGI is running in multiple interpreter mode *** Aug 07 22:36:35.850761 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: spawned uWSGI master process (pid: 129947) Aug 07 22:36:35.850958 dv-cinder-850321-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 07 22:36:35.851585 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: spawned uWSGI worker 1 (pid: 129964, cores: 1) Aug 07 22:36:35.851945 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: spawned uWSGI worker 2 (pid: 129965, cores: 1) Aug 07 22:36:35.852933 dv-cinder-850321-3-iscsi devstack@n-api.service[129947]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 07 22:36:36.515596 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 07 22:36:36.521584 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 07 22:36:37.666967 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 22:36:37.666967 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: from cryptography.utils import int_from_bytes Aug 07 22:36:37.667582 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 22:36:37.667582 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: from cryptography.utils import int_from_bytes Aug 07 22:36:37.678177 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 22:36:37.678177 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: from cryptography.utils import int_from_bytes Aug 07 22:36:37.678692 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 22:36:37.678692 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: from cryptography.utils import int_from_bytes Aug 07 22:36:39.990632 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 22:36:39.991197 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 22:36:39.991551 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 22:36:39.991668 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 22:36:39.991922 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 22:36:39.992331 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:39.992659 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:39.993515 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:39.993865 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:39.994158 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:39.994465 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:39.994787 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:39.995105 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:39.995437 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:39.995691 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:39.996005 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:39.996357 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850321-3-iscsi {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:39.996688 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:39.996994 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:39.997303 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:39.997619 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:39.997939 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:39.998246 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:39.998553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:39.999050 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.000302 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.000302 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.000502 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.000870 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.001183 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.001496 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.001818 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.002131 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.002458 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.002792 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.003184 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850321-3-iscsi {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.003496 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.003807 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.004218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.004631 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.004944 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.005272 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.005586 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.005923 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.006463 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.006811 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.007132 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.007455 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.007776 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.008112 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.008472 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.009298 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.009625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.009925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.010231 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.010481 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.010808 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.011121 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.011446 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.011766 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.012038 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.012287 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.012610 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.012933 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.013241 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.013547 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.013853 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.014159 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.014462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.014768 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.015074 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.015377 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.015698 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.016025 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.016368 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.016674 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.016996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.017398 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.017650 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.017956 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.018296 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.018613 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.018944 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.019241 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.019566 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.019868 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.020195 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.020501 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.020824 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.021160 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.021468 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.021716 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.022017 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.022321 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.022642 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.022946 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.023249 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.023553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.023853 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.024346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.024882 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.025365 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.025837 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.026313 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.026733 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.027168 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.027361 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.027777 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.027950 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.028301 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.028609 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.028914 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.029221 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.029528 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.029844 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.030151 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.030455 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.030778 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.031084 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.031387 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.031729 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.032004 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.032384 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.032557 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 22:36:40.033044 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 22:36:40.033190 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.033190 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.033495 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 22:36:40.033653 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.033798 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 22:36:40.033957 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.034109 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 22:36:40.034284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.034284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.034571 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.034729 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.034873 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.035016 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.035169 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.035320 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.035465 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.035617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.035771 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.036064 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.036328 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.036481 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.036637 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.036798 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.036954 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.037112 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.037282 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.037505 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.038531 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.038707 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.038905 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.039068 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.039226 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850321-3-iscsi {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.039373 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.039517 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.039709 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.039938 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.040272 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.040539 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.040699 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.040855 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.041009 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.041166 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.041328 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.041494 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.041742 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.042046 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.042208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.042208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.042606 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.042779 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.042926 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.043078 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.043225 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.043384 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.043531 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.043676 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.043832 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.043985 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.044188 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.044335 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.044481 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.044625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.044779 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.044936 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.045091 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.045244 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.045397 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.045549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.045695 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.045850 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.046095 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850321-3-iscsi {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.046346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.046585 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.049129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.049359 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.049533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.049730 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.049887 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.050035 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.050192 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.050373 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.050554 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.051087 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.051241 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.051408 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.051561 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.051723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.051879 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.052097 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.053822 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.054004 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.054167 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.054334 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.054482 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.054637 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.054794 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.054953 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.055109 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.055785 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.055945 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.058454 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.058650 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.058830 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.059000 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.059153 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.059302 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.059450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.059605 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.059753 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.059976 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.060180 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.060329 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.060476 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.060621 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.060866 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.061036 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.061196 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.062719 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.062900 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.063059 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.063222 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.063395 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.063543 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.063689 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.063842 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.063994 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.064197 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.064355 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.064508 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.064965 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.065131 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.065288 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.065444 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.065601 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.065747 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.065892 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.066036 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.066213 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.066457 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.066695 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.066917 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.067067 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.067212 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.067535 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.067691 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.067806 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.067919 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.068049 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.074986 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.075961 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.076925 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.077099 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.077099 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.077408 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.077576 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.077736 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.077893 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.078133 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.078306 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.078462 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.078623 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.078773 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.078920 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.079066 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.079211 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.079367 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.079520 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.079667 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.079813 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.080030 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.080259 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.080563 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.080760 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.080915 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.081071 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.081219 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.081364 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.081519 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.081677 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.081824 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.081824 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.082205 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.082357 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.082530 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.082678 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.082823 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.082969 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.083162 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.083327 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.083495 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.083657 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.083811 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.083958 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.084133 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.084331 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.084331 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.084638 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.084803 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.084954 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.085109 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.085879 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.086052 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.086256 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.086439 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.087099 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.087294 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.087536 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.087845 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.088091 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.088273 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.088466 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.088626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.088781 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.088948 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.089370 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.089539 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.089695 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.089842 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.089987 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.090188 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.090400 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.090584 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.090746 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.090892 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.091052 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.091199 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.091345 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.091345 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.091693 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.091850 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.092005 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.092188 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.092344 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.092644 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.092797 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.092954 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.093109 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.093262 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.093416 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.093579 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.093727 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.093873 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.094026 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.094171 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.094325 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.094325 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.094738 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.094898 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.094898 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.095190 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.095349 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.096047 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.096219 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.096367 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.096514 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.096702 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.096863 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.097117 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.097277 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.097392 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.097513 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.097628 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.097759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.097881 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.097993 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.098113 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.098225 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.098336 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.098478 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.098803 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.098933 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.099046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.099165 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.099277 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.099406 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.099527 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.099639 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.099639 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.099639 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 22:36:40.099639 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.099639 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.100262 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.100380 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.105234 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.105234 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.105234 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.105234 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.105234 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.105234 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.106634 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.106789 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.106789 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.107130 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.107280 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.107434 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.107595 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.107742 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.107898 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.108161 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.108328 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.108476 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.108623 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.108783 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.108972 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.109124 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.109271 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.109431 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.109589 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.109746 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.109898 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.110053 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.110216 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.110414 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.110598 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.110763 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.110918 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.111098 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.111256 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.111412 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.111570 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.111726 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.111880 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.112057 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.112224 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.112425 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.112587 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.112742 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.112888 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.113092 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.113245 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.113400 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.113561 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.113709 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.113854 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.114007 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.114161 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.114325 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.114481 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.114635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.114789 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.114943 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.115096 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.115250 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.115426 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.115675 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.116325 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.116499 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.116648 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.116808 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.116966 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.118275 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.118451 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.118610 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.118795 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.118949 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.119141 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.119293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.119464 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.119849 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.119997 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.120224 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.120421 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.120629 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.120785 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.120940 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.121096 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.121243 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.121397 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.121565 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.121720 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.121867 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.122021 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.122176 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.122343 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.122504 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.122651 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.122797 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.122951 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.123097 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.123250 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.128122 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.128358 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.128523 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.128692 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.128845 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.129043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.129219 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.129417 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.129578 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.129736 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.129884 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.130074 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.130382 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.130615 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.130731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.130850 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.130964 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.131087 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.131529 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.131659 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.131780 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.131780 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.132007 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.138119 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.138233 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.138365 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.138458 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.138559 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.138646 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.138788 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.138881 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.138975 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.139060 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.139151 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.139313 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.139402 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.139487 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.139487 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.139639 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.139732 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.139873 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.139984 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.140294 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.140294 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.140502 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.140661 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.140773 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.140862 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.140953 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.141047 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.141047 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.141210 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.141304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.141410 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.141503 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.141595 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.141680 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.141778 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.141860 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.141988 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.142070 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.142167 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.142260 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.142379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.142474 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.142567 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.142661 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.142759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.142848 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.142941 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.142941 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.143112 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.143223 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.143354 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.143442 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.143534 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.143627 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.143721 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.143822 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.143910 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.144061 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.144163 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.144163 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.144319 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.144412 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.144506 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.144591 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.144682 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.144767 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.144865 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.144959 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.145052 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.145145 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.145229 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.145320 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.145414 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.145499 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.145590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.145683 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.145768 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.145852 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.145949 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.146072 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.146166 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.146265 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.146494 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.146798 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.146913 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.147003 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.147088 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.147181 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.147268 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.147360 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.147460 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.147547 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.147633 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.147765 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.147859 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.147955 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.148079 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.148166 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.148252 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.148343 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.148436 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.148530 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.148626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.148711 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.148841 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.148942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.149713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.149891 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.150026 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.150166 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.150289 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.150375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.150472 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.150713 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.150812 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.150886 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.150958 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.151028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.151116 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.151302 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.151399 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.151494 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.151494 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.151650 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.151749 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.151844 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.151929 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.152028 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.154992 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.155101 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.155189 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.155273 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.155354 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.155435 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.155515 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.155597 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.155672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.155752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.155828 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.155956 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.156154 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.156262 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.156347 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.156421 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.156674 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.156752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.156832 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.156921 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.157042 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.157125 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.157215 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.157298 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.157378 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.157465 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.157607 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.157763 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.157849 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.157932 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.158109 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.158191 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.158263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.158346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.158427 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.158508 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.158508 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.158650 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.158730 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.158804 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.158875 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.158953 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.159040 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.159159 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.159244 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.159326 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.159399 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.159470 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.159550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.159624 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.159711 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.159784 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.159864 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.159945 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.160082 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.160165 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.160238 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.160322 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.160404 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.160535 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.160535 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.160690 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.160785 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.160862 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.160942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.161024 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.161105 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.161316 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.161405 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.161487 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.161568 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.161650 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.161810 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.161810 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.161941 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.162012 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.162091 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.162300 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.162390 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.162390 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.162552 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.162646 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.162746 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.162847 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.162941 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.163034 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.163120 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.163203 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.163296 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.163296 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.163461 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.163554 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.163641 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.163806 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.163909 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.163909 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.164126 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.164236 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.164314 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.164386 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.164467 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.164547 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.164686 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.165299 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.165389 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.165538 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.165681 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.165778 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.165853 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.165926 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.166006 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.166088 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.166169 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.166292 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.166374 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.166447 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.166518 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.166764 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.166863 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.166946 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.167020 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.167020 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.167147 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.167419 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.167504 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.167576 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.167655 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.167736 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.167823 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.167904 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.167985 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.168083 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.168170 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.168260 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.168348 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.168430 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.168503 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.168581 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.168654 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.168733 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.168814 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.168814 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.168952 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.169031 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.169111 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.169190 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.169190 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.169391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.169476 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.169556 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.169629 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.169711 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.169792 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.169864 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.169943 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.170026 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.170100 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.170199 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.170325 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.170452 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.170553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.170656 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.170743 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.170816 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.170907 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.170993 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.171090 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.171184 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.171269 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.171377 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.171583 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.171675 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.171764 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.171840 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.171920 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.171993 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.172215 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.172300 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.172389 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.172484 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.172617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.172710 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.172795 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.172879 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.172965 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.173052 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.173144 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.173230 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.173230 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.173392 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.173479 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.173479 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.173631 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.173631 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.173779 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.173873 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.173959 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.173959 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.174113 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.174204 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.174289 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.174470 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.174573 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.174573 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.174802 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.174898 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.174993 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.175089 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.175183 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.175283 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.175377 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.175471 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.175567 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.175655 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.175751 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.175837 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.175931 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.176038 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.176141 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.176238 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.176325 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.176418 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.176511 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.176597 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.176692 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.176692 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.177013 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.177103 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.177197 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.177283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.177379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.177466 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.177550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.177634 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.177727 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.177827 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.177914 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.178000 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.178091 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.178178 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.178269 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.178269 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.178269 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.178269 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.178269 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.178730 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.178866 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.178967 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.179062 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.179148 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.179241 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.179328 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.179413 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.179508 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.179602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.179689 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.179780 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.179868 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.179967 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.180099 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.180191 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.180308 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.180403 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.180497 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.180598 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.180694 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.180833 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.180966 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.181057 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.181143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.181143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.181317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.181411 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.181499 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.181584 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.181758 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.181893 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.182007 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.182100 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.182185 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.182309 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.182430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.182533 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.182628 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.182628 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.182792 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.182884 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.182982 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.183069 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.183154 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.183244 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.183330 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.183422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.183517 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.183611 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.183704 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.183798 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.183891 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.183985 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.184169 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.184267 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.184354 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.184438 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.184564 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.184668 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.184763 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.184849 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.184930 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.185029 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.185116 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.185211 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.185298 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.185390 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.185524 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.185614 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.185703 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.185798 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.185891 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.185984 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.186085 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.186179 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.186273 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.186372 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.186468 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.186596 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.186695 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.186790 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.186949 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.187041 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.187136 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.187222 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.187307 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.187392 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.187490 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.187578 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.187662 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.187748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.187832 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.187917 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.188062 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.188192 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.188305 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.188401 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.188495 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.188589 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.188685 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.188774 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.188859 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.188951 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.189038 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.189132 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.189218 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.189303 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.189375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.189466 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.189552 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.189651 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.189738 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.189829 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.189929 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.190028 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.190124 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.190217 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.190310 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.190396 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.190480 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.190579 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.190579 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.190744 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.190828 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.190920 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.191001 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.191095 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.191189 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.191284 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.191377 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.191470 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.191563 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.191658 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.191744 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.191836 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.191970 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.192107 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.192210 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.192307 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.192445 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.192558 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.192659 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.192746 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.192841 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.192927 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.193013 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.193086 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.193177 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.193265 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.193359 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.193452 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.193546 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.193632 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.193723 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.193817 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.193912 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.193998 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.193998 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.194160 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.194253 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.194346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.194450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.194537 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.194694 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.194790 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.194876 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.194977 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.195064 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.195149 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.195233 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.195325 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.195411 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.195510 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.195510 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.195672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.195765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.195898 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.195996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.196239 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.196365 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.196465 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.196560 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.196648 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.196744 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.196839 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.196925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.197011 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.197139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.197234 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.197407 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.197497 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.197591 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.197677 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.197763 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.198008 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.198116 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.198215 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.198352 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.198448 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.198542 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.198639 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.198726 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.198811 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.198896 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.198990 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.199084 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.199181 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.199283 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.199371 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.199456 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.199549 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.199636 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.199734 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.199829 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.199922 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.200062 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.200211 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.200341 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.200464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.200577 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.200679 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.200767 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.200860 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.200960 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.201105 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.201204 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.201300 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.201396 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.201531 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.201634 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.201634 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.201800 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.201888 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.201973 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.201973 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.202191 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.202324 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.202414 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.202539 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.202658 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.202836 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.202928 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.203014 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.203106 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.203199 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.203286 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.203385 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.203473 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.203558 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.203643 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.203742 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.203829 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.203924 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.204048 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.204150 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.204239 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.204239 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.204401 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.204500 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.204595 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.204682 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.204809 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.204912 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.205010 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.205107 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.205194 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.205269 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.205353 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.205438 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.205532 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.205620 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.205709 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.205709 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.205871 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.205958 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.206057 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.206144 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.206230 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.206323 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.206416 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.206515 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.206602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.206688 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.206780 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.206867 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.206952 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.207046 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.207133 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.207274 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.207376 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.207471 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.207559 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.207653 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.207748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.207842 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.207928 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.208038 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.208127 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.208227 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.208323 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.208451 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.208544 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.208630 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.208735 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.208735 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.208894 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.208981 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.209073 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.209160 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.209254 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.209348 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.209441 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.209535 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.209622 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.209707 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.209801 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.209958 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.210062 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.210262 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.210356 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.210568 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.210675 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.210872 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.210969 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.211175 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.211278 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.212072 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.212181 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.212348 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.212585 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.212728 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.212907 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.213044 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.213247 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.213349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.213580 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.213674 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.213902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.214011 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.214223 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.214325 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.214551 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.214652 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.214853 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.214955 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.215160 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.215253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.215473 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.215575 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.215783 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.215878 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.216116 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.216216 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.216428 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.216522 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.216743 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.216838 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.217052 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.217146 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.217362 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.217476 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.217665 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.217910 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.218013 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.218245 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.218340 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.218565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.218668 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.218898 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.219003 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.219200 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.219303 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.219512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.219616 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.219815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.219908 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.220143 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.220240 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.220468 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.220572 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.220779 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.220880 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.221090 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.221233 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.221383 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.221516 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.221697 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.221834 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.222005 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.222141 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.222313 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.222451 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.222623 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.222752 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.222997 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.223153 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.223287 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.223419 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.223558 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.223691 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.223831 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.223973 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.224135 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.224279 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.224435 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.224572 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.224742 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.225240 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.225374 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.225513 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.225647 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.225785 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.225927 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.226058 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.226197 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.226328 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.226458 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.226595 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.226737 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.226887 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.227026 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.227746 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.228087 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.228223 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.228372 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.228504 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.228634 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.228764 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.228893 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.229022 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.229181 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.229309 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.229429 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.229549 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.229732 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.229870 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.230154 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.230275 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.230469 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.230562 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.230789 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.230899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.231106 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.231208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.231414 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.231506 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.231739 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.231834 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.232085 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.232185 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.232395 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.232538 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.232715 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.232850 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.233025 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.233171 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.233338 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.233471 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.233650 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.233787 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.233962 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.234098 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.234279 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.234425 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.234595 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.234738 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.234899 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.235033 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.235203 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.235349 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.235513 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.235656 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.235828 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.235963 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.236156 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.236307 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.236440 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.236579 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.236720 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.236859 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.237030 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.237168 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.237332 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.237468 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.237636 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.237772 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.237941 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.238233 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.238377 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.238538 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.238671 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.238838 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.238983 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.239139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.239277 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.239440 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.239585 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.239725 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.239865 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.240045 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.240185 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.240351 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.240500 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.240706 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.240842 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.240956 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.241077 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.241251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.241399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.241546 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.241680 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.241844 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.241980 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.242144 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.242280 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.242474 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.242604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.242929 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.243067 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.243240 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.243385 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.243554 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.243698 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.243860 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.244113 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.244265 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.244470 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.244615 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.244794 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.244932 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.245126 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.245262 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.245440 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.245576 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.245749 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.245885 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.246061 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.246196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.246375 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.246518 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.246900 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.247049 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.247193 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.247325 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.247466 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.247599 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.247738 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.247878 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.247999 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.248184 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.248318 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.248449 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.248579 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.248719 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.248848 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.249066 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.249201 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.249340 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.249471 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.249608 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.249741 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.249886 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.250025 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.250157 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.250287 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.250418 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.250590 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.250728 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.250900 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.251042 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.251205 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.251339 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.251512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.251647 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.251817 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.251956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.252137 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.252271 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.252444 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.252581 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.252752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.252896 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.253059 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.253184 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.253373 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.253507 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.253678 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.253820 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.253992 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.254143 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.254301 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.254437 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.254613 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.254750 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.254921 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.255067 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.255248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.255382 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.255555 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.255689 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.255892 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.256095 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.256489 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.256633 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.256811 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.256949 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.257138 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.257290 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.257432 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.257563 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.257738 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.257883 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.258025 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 22:36:40.258160 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.258433 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.258989 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.259314 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.259639 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.259980 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.260353 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.260664 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.260977 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.261288 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.261620 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.261937 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.262254 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.262569 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.262885 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.263205 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.263511 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.263826 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.264163 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.264479 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.264793 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.265105 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.265421 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.265734 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.266051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.266375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.266738 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.267067 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.267390 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.267710 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.268049 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.268369 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.268685 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.269000 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.269314 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.269635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.269974 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.270295 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.270605 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.271055 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.271377 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.271707 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.272064 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.272384 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.272716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.273047 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.273367 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.273694 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.274903 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.275263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.275633 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.275955 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.276319 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.276639 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.276953 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.277265 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.277582 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.277909 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.278225 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.278537 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.278847 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.279162 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.279472 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.279783 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.280118 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.280429 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.280743 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.281051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.281359 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.281671 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.281980 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.282289 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.282598 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.282914 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.283224 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.283538 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.283851 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.284183 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.284490 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.284838 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.285177 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.285497 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.285829 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.286144 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.286479 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.286792 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.287119 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.287449 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.287776 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.288114 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.288455 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.288770 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.289085 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.289401 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.289871 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.290186 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.290499 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.290838 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.291168 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.291479 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.291812 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.292161 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.292493 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.292813 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.293127 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.293465 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.293786 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.294256 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.294431 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.294703 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.295016 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.295334 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.295649 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.295963 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.296322 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.296645 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.296983 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.297316 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.297631 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.297963 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.298295 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.298657 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.298977 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.299330 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.299669 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.299990 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.300334 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.300645 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 22:36:40.300892 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 22:36:40.409619 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO dbcounter [None req-ff82c4a0-8be2-4729-9d78-690cf97f76a8 None None] Registered counter for database nova_api Aug 07 22:36:40.431407 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_db.sqlalchemy.engines [None req-ff82c4a0-8be2-4729-9d78-690cf97f76a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129964) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 22:36:40.438217 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writer thread running {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 22:36:40.453002 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO dbcounter [None req-6bc6c896-8ea9-4c2d-b3af-df4841c81b8a None None] Registered counter for database nova_api Aug 07 22:36:40.472576 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_db.sqlalchemy.engines [None req-6bc6c896-8ea9-4c2d-b3af-df4841c81b8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129965) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 22:36:40.479891 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writer thread running {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 22:36:40.494394 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.context [None req-ff82c4a0-8be2-4729-9d78-690cf97f76a8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6956e3f3-38cc-4e73-875d-dafdec061360(cell1) {{(pid=129964) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 22:36:40.498358 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ff82c4a0-8be2-4729-9d78-690cf97f76a8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:36:40.498833 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ff82c4a0-8be2-4729-9d78-690cf97f76a8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:36:40.500432 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ff82c4a0-8be2-4729-9d78-690cf97f76a8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:36:40.501155 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ff82c4a0-8be2-4729-9d78-690cf97f76a8 None None] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:36:40.501588 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ff82c4a0-8be2-4729-9d78-690cf97f76a8 None None] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:36:40.503574 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ff82c4a0-8be2-4729-9d78-690cf97f76a8 None None] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:36:40.505580 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO dbcounter [None req-ff82c4a0-8be2-4729-9d78-690cf97f76a8 None None] Registered counter for database nova_cell0 Aug 07 22:36:40.509889 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO dbcounter [None req-ff82c4a0-8be2-4729-9d78-690cf97f76a8 None None] Registered counter for database nova_cell1 Aug 07 22:36:40.516857 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_db.sqlalchemy.engines [None req-ff82c4a0-8be2-4729-9d78-690cf97f76a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129964) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 22:36:40.518583 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_db.sqlalchemy.engines [None req-ff82c4a0-8be2-4729-9d78-690cf97f76a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129964) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 22:36:40.524753 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writer thread running {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 22:36:40.526126 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writer thread running {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 22:36:40.536577 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.context [None req-6bc6c896-8ea9-4c2d-b3af-df4841c81b8a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6956e3f3-38cc-4e73-875d-dafdec061360(cell1) {{(pid=129965) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 22:36:40.541220 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6bc6c896-8ea9-4c2d-b3af-df4841c81b8a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:36:40.541696 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6bc6c896-8ea9-4c2d-b3af-df4841c81b8a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:36:40.543295 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6bc6c896-8ea9-4c2d-b3af-df4841c81b8a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:36:40.544055 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6bc6c896-8ea9-4c2d-b3af-df4841c81b8a None None] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:36:40.544501 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6bc6c896-8ea9-4c2d-b3af-df4841c81b8a None None] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:36:40.546506 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6bc6c896-8ea9-4c2d-b3af-df4841c81b8a None None] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:36:40.548526 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO dbcounter [None req-6bc6c896-8ea9-4c2d-b3af-df4841c81b8a None None] Registered counter for database nova_cell0 Aug 07 22:36:40.552563 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO dbcounter [None req-6bc6c896-8ea9-4c2d-b3af-df4841c81b8a None None] Registered counter for database nova_cell1 Aug 07 22:36:40.560470 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_db.sqlalchemy.engines [None req-6bc6c896-8ea9-4c2d-b3af-df4841c81b8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129965) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 22:36:40.564859 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_db.sqlalchemy.engines [None req-6bc6c896-8ea9-4c2d-b3af-df4841c81b8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129965) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 22:36:40.570110 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writer thread running {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 22:36:40.572773 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writer thread running {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 22:36:40.672539 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO dbcounter [None req-ff82c4a0-8be2-4729-9d78-690cf97f76a8 None None] Registered counter for database nova_cell0 Aug 07 22:36:40.679646 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_db.sqlalchemy.engines [None req-ff82c4a0-8be2-4729-9d78-690cf97f76a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129964) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 22:36:40.684471 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writer thread running {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 22:36:40.721097 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO dbcounter [None req-6bc6c896-8ea9-4c2d-b3af-df4841c81b8a None None] Registered counter for database nova_cell0 Aug 07 22:36:40.728624 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_db.sqlalchemy.engines [None req-6bc6c896-8ea9-4c2d-b3af-df4841c81b8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129965) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 22:36:40.733429 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writer thread running {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 22:36:41.009546 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: WARNING keystonemiddleware.auth_token [None req-ff82c4a0-8be2-4729-9d78-690cf97f76a8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 22:36:41.016027 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: WARNING keystonemiddleware.auth_token [None req-ff82c4a0-8be2-4729-9d78-690cf97f76a8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 22:36:41.056737 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: WARNING keystonemiddleware.auth_token [None req-6bc6c896-8ea9-4c2d-b3af-df4841c81b8a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 22:36:41.064114 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: WARNING keystonemiddleware.auth_token [None req-6bc6c896-8ea9-4c2d-b3af-df4841c81b8a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 22:36:41.370549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: WARNING keystonemiddleware.auth_token [None req-ff82c4a0-8be2-4729-9d78-690cf97f76a8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 22:36:41.376566 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: WARNING keystonemiddleware.auth_token [None req-ff82c4a0-8be2-4729-9d78-690cf97f76a8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 22:36:41.382974 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558768f7a9c0 pid: 129964 (default app) Aug 07 22:36:41.412173 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: WARNING keystonemiddleware.auth_token [None req-6bc6c896-8ea9-4c2d-b3af-df4841c81b8a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 22:36:41.418787 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: WARNING keystonemiddleware.auth_token [None req-6bc6c896-8ea9-4c2d-b3af-df4841c81b8a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 22:36:41.425190 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558768f7a9c0 pid: 129965 (default app) Aug 07 22:37:17.270022 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_api:SELECT=3 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:37:17.270971 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=3 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:37:17.271780 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=3 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:37:17.272539 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=3 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:37:17.864870 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=3 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:37:17.866447 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=3 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:37:17.868106 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=3 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:37:17.869043 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=3 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:37:18.511098 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-cd73070b-1c0b-4461-ba25-5b150ec5b155 tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] Action: 'create', calling method: .version_select at 0x7fc0add03dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-589722666", "metadata": {"Type": "work"}}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:37:18.526713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-cd73070b-1c0b-4461-ba25-5b150ec5b155 tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] Request method failure captured: Aug 07 22:37:18.526713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 07 22:37:18.526713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:37:18.526713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:37:18.526713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:37:18.526713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 121 Aug 07 22:37:18.526713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:37:18.526713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:37:18.526713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:37:18.526713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:37:18.526713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8D6dd0vaT66FOaBgLpdjM5I9ekXd-hbQppx5zq-Z8wwD9PZnuTO3R_1D_7t_fYb5FL6gi7EXkON6zlEBJxLLnShohaRr7n-ccEptBPjDR_20gBhmk_66ay-Q9sEMzitacIWRCQZ2xvDxFEuc2KVciAS_P0e6ZfD5XuiwG6TMyOD64J4 Aug 07 22:37:18.526713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:37:18.526713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:37:18.526713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:37:18.526713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:37:18.526713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:37:18.526713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:37:18.526713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 6fcdd19a618d41f9b498017b0197f4fd Aug 07 22:37:18.526713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-VolumesNegativeTest-1679970677 Aug 07 22:37:18.526713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:37:18.526713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:37:18.528317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6fcdd19a618d41f9b498017b0197f4fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6fcdd19a618d41f9b498017b0197f4fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6fcdd19a618d41f9b498017b0197f4fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6fcdd19a618d41f9b498017b0197f4fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:37:18.528317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-VolumesNegativeTest-1679970677 Aug 07 22:37:18.528317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 6fcdd19a618d41f9b498017b0197f4fd Aug 07 22:37:18.528317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-VolumesNegativeTest-1679970677 Aug 07 22:37:18.528317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-VolumesNegativeTest-1679970677-project Aug 07 22:37:18.528317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:37:18.528317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:37:18.528317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: ac8114f039494058804c49d95fe14176 Aug 07 22:37:18.528317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-VolumesNegativeTest-1679970677-project Aug 07 22:37:18.528317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Aug 07 22:37:18.528317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-589722666", "metadata": {"Type": "work"}}} Aug 07 22:37:18.528317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: Aug 07 22:37:18.528317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 07 22:37:18.529284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-589722666', 'metadata': {'Type': 'work'}}}} Aug 07 22:37:18.529284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:37:18.529284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:37:18.529284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 22:37:18.529284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 22:37:18.529284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 22:37:18.529284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise error Aug 07 22:37:18.529284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 07 22:37:18.529284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:18.529284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 07 22:37:18.529284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 07 22:37:18.529284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:18.529284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 07 22:37:18.529284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi '#$%' Aug 07 22:37:18.529284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:18.529284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:37:18.529284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:18.529284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:37:18.529284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:37:18.529284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:37:18.529284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:37:18.529284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:37:18.531203 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 22:37:18.531203 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 22:37:18.531203 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:37:18.531203 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:37:18.531203 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 22:37:18.531203 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 22:37:18.531203 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 22:37:18.531203 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 22:37:18.531203 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 22:37:18.531203 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 22:37:18.531203 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 07 22:37:18.531203 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:18.531203 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:37:18.531203 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:18.531203 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:37:18.531203 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:37:18.531203 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:37:18.531203 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 22:37:18.531203 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 22:37:18.532911 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 07 22:37:18.532911 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:18.533955 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-cd73070b-1c0b-4461-ba25-5b150ec5b155 tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:37:18.550320 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-cd73070b-1c0b-4461-ba25-5b150ec5b155 tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.281412 Aug 07 22:37:18.550320 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 1/1] 10.222.0.30 () {60 vars in 1156 bytes} [Sun Aug 7 22:37:17 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1288 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 07 22:37:18.557516 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f65f8728-a7f5-44d8-9ec0-543497df3155 tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] Action: 'create', calling method: .version_select at 0x7fc0adc0d8b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1411673943", "metadata": {"Type": "work"}}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:37:18.561752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f65f8728-a7f5-44d8-9ec0-543497df3155 tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] Request method failure captured: Aug 07 22:37:18.561752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 07 22:37:18.561752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:37:18.561752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:37:18.561752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:37:18.561752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 120 Aug 07 22:37:18.561752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:37:18.561752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:37:18.561752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:37:18.561752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:37:18.561752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8D6dd0vaT66FOaBgLpdjM5I9ekXd-hbQppx5zq-Z8wwD9PZnuTO3R_1D_7t_fYb5FL6gi7EXkON6zlEBJxLLnShohaRr7n-ccEptBPjDR_20gBhmk_66ay-Q9sEMzitacIWRCQZ2xvDxFEuc2KVciAS_P0e6ZfD5XuiwG6TMyOD64J4 Aug 07 22:37:18.561752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:37:18.561752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:37:18.561752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:37:18.561752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:37:18.561752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:37:18.561752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:37:18.561752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 6fcdd19a618d41f9b498017b0197f4fd Aug 07 22:37:18.561752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-VolumesNegativeTest-1679970677 Aug 07 22:37:18.561752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:37:18.561752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:37:18.563279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6fcdd19a618d41f9b498017b0197f4fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6fcdd19a618d41f9b498017b0197f4fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6fcdd19a618d41f9b498017b0197f4fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6fcdd19a618d41f9b498017b0197f4fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:37:18.563279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-VolumesNegativeTest-1679970677 Aug 07 22:37:18.563279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 6fcdd19a618d41f9b498017b0197f4fd Aug 07 22:37:18.563279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-VolumesNegativeTest-1679970677 Aug 07 22:37:18.563279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-VolumesNegativeTest-1679970677-project Aug 07 22:37:18.563279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:37:18.563279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:37:18.563279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: ac8114f039494058804c49d95fe14176 Aug 07 22:37:18.563279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-VolumesNegativeTest-1679970677-project Aug 07 22:37:18.563279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Aug 07 22:37:18.563279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1411673943", "metadata": {"Type": "work"}}} Aug 07 22:37:18.563279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: Aug 07 22:37:18.563279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 07 22:37:18.564281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1411673943', 'metadata': {'Type': 'work'}}}} Aug 07 22:37:18.564281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:37:18.564281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:37:18.564281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 22:37:18.564281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 22:37:18.564281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 22:37:18.564281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise error Aug 07 22:37:18.564281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 07 22:37:18.564281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:18.564281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 07 22:37:18.564281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 07 22:37:18.564281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:18.564281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 07 22:37:18.564281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi '0' Aug 07 22:37:18.564281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:18.564281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:37:18.564281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:18.564281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:37:18.564281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:37:18.564281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:37:18.564281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:37:18.564281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:37:18.565777 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 22:37:18.565777 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 22:37:18.565777 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:37:18.565777 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:37:18.565777 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 22:37:18.565777 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 22:37:18.565777 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 22:37:18.565777 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 22:37:18.565777 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 22:37:18.565777 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 22:37:18.565777 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 07 22:37:18.565777 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:18.565777 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:37:18.565777 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:18.565777 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:37:18.565777 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:37:18.565777 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:37:18.565777 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 22:37:18.565777 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 22:37:18.567079 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 07 22:37:18.567079 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:18.567079 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f65f8728-a7f5-44d8-9ec0-543497df3155 tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:37:18.567079 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f65f8728-a7f5-44d8-9ec0-543497df3155 tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012452 Aug 07 22:37:18.571945 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 2/2] 10.222.0.30 () {60 vars in 1156 bytes} [Sun Aug 7 22:37:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 22:37:18.579119 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f333b41c-3c73-4042-96a0-f287901e05eb tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] Action: 'create', calling method: .version_select at 0x7fc0adbcc9d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-774024549", "metadata": {"Type": "work"}}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:37:18.583906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f333b41c-3c73-4042-96a0-f287901e05eb tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] Request method failure captured: Aug 07 22:37:18.583906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 07 22:37:18.583906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:37:18.583906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:37:18.583906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:37:18.583906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 118 Aug 07 22:37:18.583906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:37:18.583906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:37:18.583906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:37:18.583906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:37:18.583906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8D6dd0vaT66FOaBgLpdjM5I9ekXd-hbQppx5zq-Z8wwD9PZnuTO3R_1D_7t_fYb5FL6gi7EXkON6zlEBJxLLnShohaRr7n-ccEptBPjDR_20gBhmk_66ay-Q9sEMzitacIWRCQZ2xvDxFEuc2KVciAS_P0e6ZfD5XuiwG6TMyOD64J4 Aug 07 22:37:18.583906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:37:18.583906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:37:18.583906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:37:18.583906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:37:18.583906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:37:18.583906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:37:18.583906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 6fcdd19a618d41f9b498017b0197f4fd Aug 07 22:37:18.583906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-VolumesNegativeTest-1679970677 Aug 07 22:37:18.583906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:37:18.583906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:37:18.585606 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6fcdd19a618d41f9b498017b0197f4fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6fcdd19a618d41f9b498017b0197f4fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6fcdd19a618d41f9b498017b0197f4fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6fcdd19a618d41f9b498017b0197f4fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:37:18.585606 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-VolumesNegativeTest-1679970677 Aug 07 22:37:18.585606 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 6fcdd19a618d41f9b498017b0197f4fd Aug 07 22:37:18.585606 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-VolumesNegativeTest-1679970677 Aug 07 22:37:18.585606 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-VolumesNegativeTest-1679970677-project Aug 07 22:37:18.585606 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:37:18.585606 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:37:18.585606 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: ac8114f039494058804c49d95fe14176 Aug 07 22:37:18.585606 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-VolumesNegativeTest-1679970677-project Aug 07 22:37:18.585606 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Aug 07 22:37:18.585606 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-774024549", "metadata": {"Type": "work"}}} Aug 07 22:37:18.585606 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: Aug 07 22:37:18.585606 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 07 22:37:18.586408 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-774024549', 'metadata': {'Type': 'work'}}}} Aug 07 22:37:18.586408 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:37:18.586408 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:37:18.586408 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 22:37:18.586408 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 22:37:18.586408 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 22:37:18.586408 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise error Aug 07 22:37:18.586408 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 07 22:37:18.586408 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:18.586408 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 07 22:37:18.586408 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 07 22:37:18.586408 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:18.586408 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 07 22:37:18.586408 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi '' Aug 07 22:37:18.586408 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:18.586408 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:37:18.586408 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:18.586408 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:37:18.586408 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:37:18.586408 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:37:18.586408 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:37:18.586408 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:37:18.589759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 22:37:18.589759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 22:37:18.589759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:37:18.589759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:37:18.589759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 22:37:18.589759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 22:37:18.589759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 22:37:18.589759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 22:37:18.589759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 22:37:18.589759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 22:37:18.589759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 07 22:37:18.589759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:18.589759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:37:18.589759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:18.589759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:37:18.589759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:37:18.589759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:37:18.589759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 22:37:18.589759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 22:37:18.591042 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 07 22:37:18.591042 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:18.591042 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f333b41c-3c73-4042-96a0-f287901e05eb tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:37:18.591042 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f333b41c-3c73-4042-96a0-f287901e05eb tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012030 Aug 07 22:37:18.591518 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 3/3] 10.222.0.30 () {60 vars in 1156 bytes} [Sun Aug 7 22:37:18 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 22:37:18.597081 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-df33d9a4-cf76-4d0f-84db-2a50c3fbf32b tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] Calling method '.version_select at 0x7fc0adbcc670>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:18.869754 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-45dd86b1-b629-4e54-9245-ddf71a305749 tempest-VolumesGetTestJSON-1805422107 tempest-VolumesGetTestJSON-1805422107-project] Action: 'create', calling method: .version_select at 0x7fc0add05dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-300192565", "metadata": {"Type": "work"}}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:37:19.508102 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-df33d9a4-cf76-4d0f-84db-2a50c3fbf32b tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] HTTP exception thrown: Volume tempest-invalid-1124205326 could not be found. Aug 07 22:37:19.512511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-df33d9a4-cf76-4d0f-84db-2a50c3fbf32b tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] Request method failure captured: Aug 07 22:37:19.512511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1124205326 HTTP/1.1 Aug 07 22:37:19.512511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:37:19.512511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:37:19.512511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:37:19.512511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:37:19.512511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:37:19.512511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:37:19.512511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:37:19.512511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:37:19.512511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8D6dd0vaT66FOaBgLpdjM5I9ekXd-hbQppx5zq-Z8wwD9PZnuTO3R_1D_7t_fYb5FL6gi7EXkON6zlEBJxLLnShohaRr7n-ccEptBPjDR_20gBhmk_66ay-Q9sEMzitacIWRCQZ2xvDxFEuc2KVciAS_P0e6ZfD5XuiwG6TMyOD64J4 Aug 07 22:37:19.512511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:37:19.512511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:37:19.512511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:37:19.512511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:37:19.512511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:37:19.512511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:37:19.512511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 6fcdd19a618d41f9b498017b0197f4fd Aug 07 22:37:19.512511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-VolumesNegativeTest-1679970677 Aug 07 22:37:19.512511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:37:19.512511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:37:19.514436 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6fcdd19a618d41f9b498017b0197f4fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6fcdd19a618d41f9b498017b0197f4fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6fcdd19a618d41f9b498017b0197f4fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6fcdd19a618d41f9b498017b0197f4fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:37:19.514436 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-VolumesNegativeTest-1679970677 Aug 07 22:37:19.514436 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 6fcdd19a618d41f9b498017b0197f4fd Aug 07 22:37:19.514436 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-VolumesNegativeTest-1679970677 Aug 07 22:37:19.514436 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-VolumesNegativeTest-1679970677-project Aug 07 22:37:19.514436 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:37:19.514436 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:37:19.514436 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: ac8114f039494058804c49d95fe14176 Aug 07 22:37:19.514436 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-VolumesNegativeTest-1679970677-project Aug 07 22:37:19.514436 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: Aug 07 22:37:19.514436 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Volume tempest-invalid-1124205326 could not be found. Aug 07 22:37:19.514436 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': 'tempest-invalid-1124205326'} Aug 07 22:37:19.514436 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:37:19.515416 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:37:19.515416 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 22:37:19.515416 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 22:37:19.515416 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 22:37:19.515416 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 22:37:19.515416 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 22:37:19.515416 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 22:37:19.515416 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 22:37:19.515416 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 22:37:19.515416 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 22:37:19.515416 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 22:37:19.515416 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 22:37:19.515416 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 22:37:19.515416 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 22:37:19.515416 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 22:37:19.515416 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1124205326 could not be found. (HTTP 404) (Request-ID: req-8d216ca7-7b22-4781-8f84-329b8bbe704a) Aug 07 22:37:19.515416 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:19.515416 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:37:19.515416 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:19.516857 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:37:19.516857 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 07 22:37:19.516857 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 07 22:37:19.516857 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 22:37:19.516857 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 22:37:19.516857 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 22:37:19.516857 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 22:37:19.516857 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 22:37:19.516857 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 22:37:19.516857 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 22:37:19.516857 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 22:37:19.516857 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 22:37:19.516857 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 22:37:19.516857 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 22:37:19.516857 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 22:37:19.516857 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 22:37:19.516857 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 22:37:19.516857 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 22:37:19.516857 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 22:37:19.518248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 22:37:19.518248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 22:37:19.518248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 22:37:19.518248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 22:37:19.518248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1124205326 could not be found. Aug 07 22:37:19.518248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:19.518248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:37:19.518248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:19.518248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:37:19.518248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:37:19.518248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:37:19.518248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:37:19.518248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:37:19.518248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 22:37:19.518248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 22:37:19.518248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:37:19.518248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:37:19.518248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 07 22:37:19.518248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:37:19.518248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1124205326 could not be found. Aug 07 22:37:19.519650 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:19.519650 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:37:19.519650 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:19.519650 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:37:19.519650 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:37:19.519650 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:37:19.519650 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:37:19.519650 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:37:19.519650 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1124205326 could not be found. Aug 07 22:37:19.519650 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:19.519650 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-df33d9a4-cf76-4d0f-84db-2a50c3fbf32b tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] Returning 404 to user: Volume tempest-invalid-1124205326 could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:37:19.519650 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-df33d9a4-cf76-4d0f-84db-2a50c3fbf32b tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1124205326" status: 404 len: 99 microversion: 2.1 time: 0.921671 Aug 07 22:37:19.519650 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 4/4] 10.222.0.30 () {58 vars in 1218 bytes} [Sun Aug 7 22:37:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1124205326 => generated 99 bytes in 923 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 22:37:19.536229 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-47a69d16-2eb1-47bd-a03e-2506e4d50462 tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015249 Aug 07 22:37:19.542283 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 5/5] 10.222.0.30 () {58 vars in 1140 bytes} [Sun Aug 7 22:37:19 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 07 22:37:19.546870 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-65477c00-636c-4d23-aeaa-d846b5922263 tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003542 Aug 07 22:37:19.552705 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 6/6] 10.222.0.30 () {58 vars in 1137 bytes} [Sun Aug 7 22:37:19 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 07 22:37:19.561318 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-4c22f1b3-61f3-433b-9519-5bb04fefa511 tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] Calling method '.version_select at 0x7fc0adb0aca0>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:20.130696 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-4c22f1b3-61f3-433b-9519-5bb04fefa511 tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] HTTP exception thrown: Volume beb9d0d7-adc6-4334-a4a7-10a2cd57b2f4 could not be found. Aug 07 22:37:20.132524 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-4c22f1b3-61f3-433b-9519-5bb04fefa511 tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] Request method failure captured: Aug 07 22:37:20.132524 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: DELETE /compute/v2.1/os-volumes/beb9d0d7-adc6-4334-a4a7-10a2cd57b2f4 HTTP/1.1 Aug 07 22:37:20.132524 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:37:20.132524 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:37:20.132524 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:37:20.132524 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:37:20.132524 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:37:20.132524 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:37:20.132524 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:37:20.132524 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:37:20.132524 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8D6dd0vaT66FOaBgLpdjM5I9ekXd-hbQppx5zq-Z8wwD9PZnuTO3R_1D_7t_fYb5FL6gi7EXkON6zlEBJxLLnShohaRr7n-ccEptBPjDR_20gBhmk_66ay-Q9sEMzitacIWRCQZ2xvDxFEuc2KVciAS_P0e6ZfD5XuiwG6TMyOD64J4 Aug 07 22:37:20.132524 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:37:20.132524 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:37:20.132524 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:37:20.132524 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:37:20.132524 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:37:20.132524 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:37:20.132524 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 6fcdd19a618d41f9b498017b0197f4fd Aug 07 22:37:20.132524 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-VolumesNegativeTest-1679970677 Aug 07 22:37:20.132524 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:37:20.132524 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:37:20.135384 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6fcdd19a618d41f9b498017b0197f4fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6fcdd19a618d41f9b498017b0197f4fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6fcdd19a618d41f9b498017b0197f4fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6fcdd19a618d41f9b498017b0197f4fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:37:20.135384 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-VolumesNegativeTest-1679970677 Aug 07 22:37:20.135384 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 6fcdd19a618d41f9b498017b0197f4fd Aug 07 22:37:20.135384 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-VolumesNegativeTest-1679970677 Aug 07 22:37:20.135384 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-VolumesNegativeTest-1679970677-project Aug 07 22:37:20.135384 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:37:20.135384 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:37:20.135384 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: ac8114f039494058804c49d95fe14176 Aug 07 22:37:20.135384 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-VolumesNegativeTest-1679970677-project Aug 07 22:37:20.135384 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: Aug 07 22:37:20.135384 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Volume beb9d0d7-adc6-4334-a4a7-10a2cd57b2f4 could not be found. Aug 07 22:37:20.135384 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': 'beb9d0d7-adc6-4334-a4a7-10a2cd57b2f4'} Aug 07 22:37:20.135384 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:37:20.136477 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:37:20.136477 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 22:37:20.136477 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 22:37:20.136477 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 22:37:20.136477 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 22:37:20.136477 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 22:37:20.136477 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 22:37:20.136477 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 22:37:20.136477 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 22:37:20.136477 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 22:37:20.136477 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 22:37:20.136477 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 22:37:20.136477 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 22:37:20.136477 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 22:37:20.136477 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 22:37:20.136477 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume beb9d0d7-adc6-4334-a4a7-10a2cd57b2f4 could not be found. (HTTP 404) (Request-ID: req-8ee2638f-14cb-4991-85a3-37dd0c9e75fb) Aug 07 22:37:20.136477 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:20.136477 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:37:20.136477 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:20.139196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:37:20.139196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 07 22:37:20.139196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 07 22:37:20.139196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 22:37:20.139196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 22:37:20.139196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 22:37:20.139196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 22:37:20.139196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 22:37:20.139196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 22:37:20.139196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 22:37:20.139196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 22:37:20.139196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 22:37:20.139196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 22:37:20.139196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 22:37:20.139196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 22:37:20.139196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 22:37:20.139196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 22:37:20.139196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 22:37:20.139196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 22:37:20.143240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 22:37:20.143240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 22:37:20.143240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 22:37:20.143240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 22:37:20.143240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume beb9d0d7-adc6-4334-a4a7-10a2cd57b2f4 could not be found. Aug 07 22:37:20.143240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:20.143240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:37:20.143240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:20.143240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:37:20.143240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:37:20.143240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:37:20.143240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:37:20.143240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:37:20.143240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 22:37:20.143240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 22:37:20.143240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:37:20.143240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:37:20.143240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 07 22:37:20.143240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:37:20.146249 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume beb9d0d7-adc6-4334-a4a7-10a2cd57b2f4 could not be found. Aug 07 22:37:20.146249 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:20.146249 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:37:20.146249 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:20.146249 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:37:20.146249 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:37:20.146249 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:37:20.146249 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:37:20.146249 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:37:20.146249 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume beb9d0d7-adc6-4334-a4a7-10a2cd57b2f4 could not be found. Aug 07 22:37:20.146249 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:20.146249 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-4c22f1b3-61f3-433b-9519-5bb04fefa511 tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] Returning 404 to user: Volume beb9d0d7-adc6-4334-a4a7-10a2cd57b2f4 could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:37:20.146249 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-4c22f1b3-61f3-433b-9519-5bb04fefa511 tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/beb9d0d7-adc6-4334-a4a7-10a2cd57b2f4" status: 404 len: 109 microversion: 2.1 time: 0.577051 Aug 07 22:37:20.146249 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 7/7] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Aug 7 22:37:19 2022] DELETE /compute/v2.1/os-volumes/beb9d0d7-adc6-4334-a4a7-10a2cd57b2f4 => generated 109 bytes in 579 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 22:37:20.149312 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-c8bdd184-d6d3-4484-b7f6-8221ccb7f41c tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] Calling method '.version_select at 0x7fc0adb0ad30>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:20.339844 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-c8bdd184-d6d3-4484-b7f6-8221ccb7f41c tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] HTTP exception thrown: Volume a824f582-615a-47da-82ca-92dbb077d7a6 could not be found. Aug 07 22:37:20.342175 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-c8bdd184-d6d3-4484-b7f6-8221ccb7f41c tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] Request method failure captured: Aug 07 22:37:20.342175 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: GET /compute/v2.1/os-volumes/a824f582-615a-47da-82ca-92dbb077d7a6 HTTP/1.1 Aug 07 22:37:20.342175 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:37:20.342175 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:37:20.342175 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:37:20.342175 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:37:20.342175 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:37:20.342175 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:37:20.342175 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:37:20.342175 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:37:20.342175 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8D6dd0vaT66FOaBgLpdjM5I9ekXd-hbQppx5zq-Z8wwD9PZnuTO3R_1D_7t_fYb5FL6gi7EXkON6zlEBJxLLnShohaRr7n-ccEptBPjDR_20gBhmk_66ay-Q9sEMzitacIWRCQZ2xvDxFEuc2KVciAS_P0e6ZfD5XuiwG6TMyOD64J4 Aug 07 22:37:20.342175 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:37:20.342175 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:37:20.342175 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:37:20.342175 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:37:20.342175 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:37:20.342175 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:37:20.342175 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 6fcdd19a618d41f9b498017b0197f4fd Aug 07 22:37:20.342175 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-VolumesNegativeTest-1679970677 Aug 07 22:37:20.342175 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:37:20.342175 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:37:20.343516 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6fcdd19a618d41f9b498017b0197f4fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6fcdd19a618d41f9b498017b0197f4fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6fcdd19a618d41f9b498017b0197f4fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6fcdd19a618d41f9b498017b0197f4fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:37:20.343516 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-VolumesNegativeTest-1679970677 Aug 07 22:37:20.343516 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 6fcdd19a618d41f9b498017b0197f4fd Aug 07 22:37:20.343516 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-VolumesNegativeTest-1679970677 Aug 07 22:37:20.343516 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-VolumesNegativeTest-1679970677-project Aug 07 22:37:20.343516 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:37:20.343516 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:37:20.343516 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: ac8114f039494058804c49d95fe14176 Aug 07 22:37:20.343516 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-VolumesNegativeTest-1679970677-project Aug 07 22:37:20.343516 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: Aug 07 22:37:20.343516 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Volume a824f582-615a-47da-82ca-92dbb077d7a6 could not be found. Aug 07 22:37:20.343516 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': 'a824f582-615a-47da-82ca-92dbb077d7a6'} Aug 07 22:37:20.343516 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:37:20.344349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:37:20.344349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 22:37:20.344349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 22:37:20.344349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 22:37:20.344349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 22:37:20.344349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 22:37:20.344349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 22:37:20.344349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 22:37:20.344349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 22:37:20.344349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 22:37:20.344349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 22:37:20.344349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 22:37:20.344349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 22:37:20.344349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 22:37:20.344349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 22:37:20.344349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a824f582-615a-47da-82ca-92dbb077d7a6 could not be found. (HTTP 404) (Request-ID: req-549ad461-b2c6-4670-9444-cb6aec5d9459) Aug 07 22:37:20.344349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:20.344349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:37:20.344349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:20.345590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:37:20.345590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 07 22:37:20.345590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 07 22:37:20.345590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 22:37:20.345590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 22:37:20.345590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 22:37:20.345590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 22:37:20.345590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 22:37:20.345590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 22:37:20.345590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 22:37:20.345590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 22:37:20.345590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 22:37:20.345590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 22:37:20.345590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 22:37:20.345590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 22:37:20.345590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 22:37:20.345590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 22:37:20.345590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 22:37:20.345590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 22:37:20.349989 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 22:37:20.349989 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 22:37:20.349989 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 22:37:20.349989 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 22:37:20.349989 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a824f582-615a-47da-82ca-92dbb077d7a6 could not be found. Aug 07 22:37:20.349989 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:20.349989 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:37:20.349989 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:20.349989 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:37:20.349989 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:37:20.349989 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:37:20.349989 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:37:20.349989 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:37:20.349989 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 22:37:20.349989 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 22:37:20.349989 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:37:20.349989 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:37:20.349989 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 07 22:37:20.349989 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:37:20.354114 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a824f582-615a-47da-82ca-92dbb077d7a6 could not be found. Aug 07 22:37:20.354114 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:20.354114 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:37:20.354114 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:20.354114 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:37:20.354114 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:37:20.354114 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:37:20.354114 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:37:20.354114 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:37:20.354114 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a824f582-615a-47da-82ca-92dbb077d7a6 could not be found. Aug 07 22:37:20.354114 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:37:20.354114 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-c8bdd184-d6d3-4484-b7f6-8221ccb7f41c tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] Returning 404 to user: Volume a824f582-615a-47da-82ca-92dbb077d7a6 could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:37:20.354114 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-c8bdd184-d6d3-4484-b7f6-8221ccb7f41c tempest-VolumesNegativeTest-1679970677 tempest-VolumesNegativeTest-1679970677-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/a824f582-615a-47da-82ca-92dbb077d7a6" status: 404 len: 109 microversion: 2.1 time: 0.201618 Aug 07 22:37:20.362837 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 8/8] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 22:37:20 2022] GET /compute/v2.1/os-volumes/a824f582-615a-47da-82ca-92dbb077d7a6 => generated 109 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 22:37:21.176517 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-45dd86b1-b629-4e54-9245-ddf71a305749 tempest-VolumesGetTestJSON-1805422107 tempest-VolumesGetTestJSON-1805422107-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.326371 Aug 07 22:37:21.179849 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 1/9] 10.222.0.30 () {60 vars in 1156 bytes} [Sun Aug 7 22:37:17 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3333 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 07 22:37:21.194694 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f9972a1e-4ee6-4039-aa55-55508714439b tempest-VolumesGetTestJSON-1805422107 tempest-VolumesGetTestJSON-1805422107-project] Calling method '.version_select at 0x7fc0adbcc280>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:21.463089 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f9972a1e-4ee6-4039-aa55-55508714439b tempest-VolumesGetTestJSON-1805422107 tempest-VolumesGetTestJSON-1805422107-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/707e11a2-fca2-4a3f-8c86-7d01f6f851ff" status: 200 len: 352 microversion: 2.1 time: 0.272552 Aug 07 22:37:21.463661 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 9/10] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 22:37:21 2022] GET /compute/v2.1/os-volumes/707e11a2-fca2-4a3f-8c86-7d01f6f851ff => generated 352 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:37:22.482772 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-fa107861-f8dd-4767-b962-ada2ae262aec tempest-VolumesGetTestJSON-1805422107 tempest-VolumesGetTestJSON-1805422107-project] Calling method '.version_select at 0x7fc0adbf1c10>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:22.810321 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-fa107861-f8dd-4767-b962-ada2ae262aec tempest-VolumesGetTestJSON-1805422107 tempest-VolumesGetTestJSON-1805422107-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/707e11a2-fca2-4a3f-8c86-7d01f6f851ff" status: 200 len: 353 microversion: 2.1 time: 0.336688 Aug 07 22:37:22.810879 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 2/11] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 22:37:22 2022] GET /compute/v2.1/os-volumes/707e11a2-fca2-4a3f-8c86-7d01f6f851ff => generated 353 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:37:22.824618 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-4019f520-89f2-4cfd-960b-31f67985d9cb tempest-VolumesGetTestJSON-1805422107 tempest-VolumesGetTestJSON-1805422107-project] Calling method '.version_select at 0x7fc0adb0a1f0>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:22.947180 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-4019f520-89f2-4cfd-960b-31f67985d9cb tempest-VolumesGetTestJSON-1805422107 tempest-VolumesGetTestJSON-1805422107-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/707e11a2-fca2-4a3f-8c86-7d01f6f851ff" status: 200 len: 353 microversion: 2.1 time: 0.126165 Aug 07 22:37:22.947731 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 10/12] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 22:37:22 2022] GET /compute/v2.1/os-volumes/707e11a2-fca2-4a3f-8c86-7d01f6f851ff => generated 353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:37:22.960977 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d89d9f1c-34e6-4f6e-bef5-1fe653b346cd tempest-VolumesGetTestJSON-1805422107 tempest-VolumesGetTestJSON-1805422107-project] Calling method '.version_select at 0x7fc0adb943a0>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:23.229781 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-d89d9f1c-34e6-4f6e-bef5-1fe653b346cd tempest-VolumesGetTestJSON-1805422107 tempest-VolumesGetTestJSON-1805422107-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/707e11a2-fca2-4a3f-8c86-7d01f6f851ff" status: 202 len: 0 microversion: 2.1 time: 0.272545 Aug 07 22:37:23.234456 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 3/13] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Aug 7 22:37:22 2022] DELETE /compute/v2.1/os-volumes/707e11a2-fca2-4a3f-8c86-7d01f6f851ff => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:37:23.244578 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-040fbeb9-97e4-476e-ae77-91879a7fa6b0 tempest-VolumesGetTestJSON-1805422107 tempest-VolumesGetTestJSON-1805422107-project] Calling method '.version_select at 0x7fc0adb23280>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:23.405291 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-040fbeb9-97e4-476e-ae77-91879a7fa6b0 tempest-VolumesGetTestJSON-1805422107 tempest-VolumesGetTestJSON-1805422107-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/707e11a2-fca2-4a3f-8c86-7d01f6f851ff" status: 200 len: 352 microversion: 2.1 time: 0.169432 Aug 07 22:37:23.406735 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 11/14] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 22:37:23 2022] GET /compute/v2.1/os-volumes/707e11a2-fca2-4a3f-8c86-7d01f6f851ff => generated 352 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:37:24.420522 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-f1613d4e-cfaa-4139-a69a-7e4065745359 tempest-VolumesGetTestJSON-1805422107 tempest-VolumesGetTestJSON-1805422107-project] Calling method '.version_select at 0x7fc0adb94a60>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:24.489971 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.wsgi [None req-f1613d4e-cfaa-4139-a69a-7e4065745359 tempest-VolumesGetTestJSON-1805422107 tempest-VolumesGetTestJSON-1805422107-project] HTTP exception thrown: Volume 707e11a2-fca2-4a3f-8c86-7d01f6f851ff could not be found. Aug 07 22:37:24.494897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-f1613d4e-cfaa-4139-a69a-7e4065745359 tempest-VolumesGetTestJSON-1805422107 tempest-VolumesGetTestJSON-1805422107-project] Request method failure captured: Aug 07 22:37:24.494897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: request: GET /compute/v2.1/os-volumes/707e11a2-fca2-4a3f-8c86-7d01f6f851ff HTTP/1.1 Aug 07 22:37:24.494897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept: application/json Aug 07 22:37:24.494897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept-Encoding: identity Aug 07 22:37:24.494897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Connection: close Aug 07 22:37:24.494897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Length: 0 Aug 07 22:37:24.494897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Type: application/json Aug 07 22:37:24.494897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Host: 10.222.0.30 Aug 07 22:37:24.494897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Openstack-System-Scope: None Aug 07 22:37:24.494897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: User-Agent: python-urllib3/1.26.11 Aug 07 22:37:24.494897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Auth-Token: gAAAAABi8D6dxJtTvImQHjWJoThxo6aL9xSqtbwkP54YgGp4ebJ-c4LD-8Bb1wrYogrEHjcEnWi5esVcm8Y8CpQbTy3Xq359M051Ur7RZ-8sdWCvUHXs0xx-s_IUxPnsL6oJJBIe8KBVS34gtyi-N2Fddy1nlvx63ffjeozEzHvvR38lZ6AgqEE Aug 07 22:37:24.494897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Id: None Aug 07 22:37:24.494897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Name: None Aug 07 22:37:24.494897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Identity-Status: Confirmed Aug 07 22:37:24.494897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Is-Admin-Project: True Aug 07 22:37:24.494897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Id: default Aug 07 22:37:24.494897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Name: Default Aug 07 22:37:24.494897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Id: bf8ae1dcb7bb4d58b383f8e992528f62 Aug 07 22:37:24.494897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Name: tempest-VolumesGetTestJSON-1805422107 Aug 07 22:37:24.494897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Role: reader,member Aug 07 22:37:24.494897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Roles: reader,member Aug 07 22:37:24.496148 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bf8ae1dcb7bb4d58b383f8e992528f62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bf8ae1dcb7bb4d58b383f8e992528f62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bf8ae1dcb7bb4d58b383f8e992528f62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bf8ae1dcb7bb4d58b383f8e992528f62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:37:24.496148 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant: tempest-VolumesGetTestJSON-1805422107 Aug 07 22:37:24.496148 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Id: bf8ae1dcb7bb4d58b383f8e992528f62 Aug 07 22:37:24.496148 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Name: tempest-VolumesGetTestJSON-1805422107 Aug 07 22:37:24.496148 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User: tempest-VolumesGetTestJSON-1805422107-project Aug 07 22:37:24.496148 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Id: default Aug 07 22:37:24.496148 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Name: Default Aug 07 22:37:24.496148 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Id: c461b1dffb1a412b9fb69bb3b2c4a5bd Aug 07 22:37:24.496148 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Name: tempest-VolumesGetTestJSON-1805422107-project Aug 07 22:37:24.496148 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: method: Aug 07 22:37:24.496148 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: exception: Volume 707e11a2-fca2-4a3f-8c86-7d01f6f851ff could not be found. Aug 07 22:37:24.496148 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: action_args: {'id': '707e11a2-fca2-4a3f-8c86-7d01f6f851ff'} Aug 07 22:37:24.496148 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:37:24.496902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:37:24.496902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 22:37:24.496902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 22:37:24.496902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 22:37:24.496902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 22:37:24.496902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 22:37:24.496902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 22:37:24.496902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 22:37:24.496902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 22:37:24.496902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 22:37:24.496902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 22:37:24.496902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 22:37:24.496902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 22:37:24.496902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 22:37:24.496902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 22:37:24.496902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 707e11a2-fca2-4a3f-8c86-7d01f6f851ff could not be found. (HTTP 404) (Request-ID: req-15fe3ce0-8562-4985-bde8-8cdd7249bb69) Aug 07 22:37:24.496902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:37:24.496902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:37:24.496902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:37:24.497956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:37:24.497956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 07 22:37:24.497956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 07 22:37:24.497956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 22:37:24.497956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 22:37:24.497956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 22:37:24.497956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 22:37:24.497956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 22:37:24.497956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 22:37:24.497956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 22:37:24.497956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 22:37:24.497956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 22:37:24.497956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 22:37:24.497956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 22:37:24.497956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 22:37:24.497956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 22:37:24.497956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 22:37:24.497956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 22:37:24.497956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 22:37:24.499042 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 22:37:24.499042 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 22:37:24.499042 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 22:37:24.499042 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 22:37:24.499042 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 707e11a2-fca2-4a3f-8c86-7d01f6f851ff could not be found. Aug 07 22:37:24.499042 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:37:24.499042 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:37:24.499042 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:37:24.499042 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:37:24.499042 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:37:24.499042 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:37:24.499042 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:37:24.499042 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:37:24.499042 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 22:37:24.499042 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 22:37:24.499042 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:37:24.499042 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:37:24.499042 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 07 22:37:24.499042 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:37:24.500400 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 707e11a2-fca2-4a3f-8c86-7d01f6f851ff could not be found. Aug 07 22:37:24.500400 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:37:24.500400 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:37:24.500400 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:37:24.500400 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:37:24.500400 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:37:24.500400 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:37:24.500400 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:37:24.500400 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:37:24.500400 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 707e11a2-fca2-4a3f-8c86-7d01f6f851ff could not be found. Aug 07 22:37:24.500400 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:37:24.500400 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-f1613d4e-cfaa-4139-a69a-7e4065745359 tempest-VolumesGetTestJSON-1805422107 tempest-VolumesGetTestJSON-1805422107-project] Returning 404 to user: Volume 707e11a2-fca2-4a3f-8c86-7d01f6f851ff could not be found. {{(pid=129965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:37:24.500400 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-f1613d4e-cfaa-4139-a69a-7e4065745359 tempest-VolumesGetTestJSON-1805422107 tempest-VolumesGetTestJSON-1805422107-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/707e11a2-fca2-4a3f-8c86-7d01f6f851ff" status: 404 len: 109 microversion: 2.1 time: 0.082078 Aug 07 22:37:24.507859 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 4/15] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 22:37:24 2022] GET /compute/v2.1/os-volumes/707e11a2-fca2-4a3f-8c86-7d01f6f851ff => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:37:31.727985 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-365865b2-749c-4553-bfaa-bb307838d337 tempest-VolumesTestJSON-1206785108 tempest-VolumesTestJSON-1206785108-project] Calling method '.version_select at 0x7fc0adafa430>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:31.943627 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-365865b2-749c-4553-bfaa-bb307838d337 tempest-VolumesTestJSON-1206785108 tempest-VolumesTestJSON-1206785108-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/22ad6cfd-ab71-495d-91ac-0c7368ada9ee" status: 200 len: 349 microversion: 2.1 time: 0.220267 Aug 07 22:37:31.952826 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 5/16] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 22:37:31 2022] GET /compute/v2.1/os-volumes/22ad6cfd-ab71-495d-91ac-0c7368ada9ee => generated 349 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:37:32.179782 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-d0e471aa-0bef-486d-acb1-ea3ef34f3421 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-263026929", "imageRef": "91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8", "flavorRef": "452", "networks": [{"uuid": "3405a859-15b9-43f0-8ee9-acabcdc8fa44"}]}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:37:32.471125 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.network.neutron [None req-d0e471aa-0bef-486d-acb1-ea3ef34f3421 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] validate_networks() for [('3405a859-15b9-43f0-8ee9-acabcdc8fa44', None, None, None, None, None)] {{(pid=129964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 22:37:33.365737 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-61f0de21-b5c7-4d1a-8572-3432e5fc35c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-263714424", "imageRef": "91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:37:33.659986 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.network.neutron [None req-61f0de21-b5c7-4d1a-8572-3432e5fc35c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] validate_networks() for [('b379400c-91c0-4503-ac16-d8b7f1c793d1', None, None, None, None, None)] {{(pid=129965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 22:37:34.474326 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-d0e471aa-0bef-486d-acb1-ea3ef34f3421 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Flavor limits 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 22:37:34.475901 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-d0e471aa-0bef-486d-acb1-ea3ef34f3421 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Image limits 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 22:37:34.477452 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-d0e471aa-0bef-486d-acb1-ea3ef34f3421 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Flavor pref 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 22:37:34.478143 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-d0e471aa-0bef-486d-acb1-ea3ef34f3421 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Image pref 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 22:37:34.479147 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-d0e471aa-0bef-486d-acb1-ea3ef34f3421 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 22:37:34.509067 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d0e471aa-0bef-486d-acb1-ea3ef34f3421 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:34.509884 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d0e471aa-0bef-486d-acb1-ea3ef34f3421 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:34.512096 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d0e471aa-0bef-486d-acb1-ea3ef34f3421 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:34.513092 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d0e471aa-0bef-486d-acb1-ea3ef34f3421 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:34.515389 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d0e471aa-0bef-486d-acb1-ea3ef34f3421 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:34.522511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d0e471aa-0bef-486d-acb1-ea3ef34f3421 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:34.642914 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-d0e471aa-0bef-486d-acb1-ea3ef34f3421 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Getting quotas for project 6cd3d94550bd467f8a88d75ec1208be1. Resources: {'cores', 'instances', 'ram'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:37:34.666893 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-d0e471aa-0bef-486d-acb1-ea3ef34f3421 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Getting quotas for user dfd02222f0b14a588b51a792b02ca852 and project 6cd3d94550bd467f8a88d75ec1208be1. Resources: {'cores', 'instances', 'ram'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:37:34.709602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-d0e471aa-0bef-486d-acb1-ea3ef34f3421 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Going to run 1 instances... {{(pid=129964) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 22:37:34.713557 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-d0e471aa-0bef-486d-acb1-ea3ef34f3421 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 22:37:34.807234 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-61f0de21-b5c7-4d1a-8572-3432e5fc35c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Flavor limits 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 22:37:34.808304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-61f0de21-b5c7-4d1a-8572-3432e5fc35c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Image limits 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 22:37:34.808704 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-61f0de21-b5c7-4d1a-8572-3432e5fc35c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Flavor pref 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 22:37:34.809122 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-61f0de21-b5c7-4d1a-8572-3432e5fc35c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Image pref 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 22:37:34.809694 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-61f0de21-b5c7-4d1a-8572-3432e5fc35c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 22:37:34.826733 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-61f0de21-b5c7-4d1a-8572-3432e5fc35c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:34.827404 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-61f0de21-b5c7-4d1a-8572-3432e5fc35c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:34.827842 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-61f0de21-b5c7-4d1a-8572-3432e5fc35c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:34.828606 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-61f0de21-b5c7-4d1a-8572-3432e5fc35c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:34.829059 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-61f0de21-b5c7-4d1a-8572-3432e5fc35c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:34.829483 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-61f0de21-b5c7-4d1a-8572-3432e5fc35c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:34.891504 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-d0e471aa-0bef-486d-acb1-ea3ef34f3421 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.414362 Aug 07 22:37:34.895649 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 12/17] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 22:37:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 3420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 22:37:34.913447 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-61f0de21-b5c7-4d1a-8572-3432e5fc35c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Getting quotas for project 1a78ad9d7151473798fbefa330678250. Resources: {'cores', 'instances', 'ram'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:37:34.925960 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-61f0de21-b5c7-4d1a-8572-3432e5fc35c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Getting quotas for user 966045fbe69f43b4b1a825da3ad571b9 and project 1a78ad9d7151473798fbefa330678250. Resources: {'cores', 'instances', 'ram'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:37:34.955362 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-61f0de21-b5c7-4d1a-8572-3432e5fc35c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Going to run 1 instances... {{(pid=129965) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 22:37:34.958414 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-61f0de21-b5c7-4d1a-8572-3432e5fc35c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 22:37:35.199964 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-61f0de21-b5c7-4d1a-8572-3432e5fc35c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.036271 Aug 07 22:37:35.211033 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 6/18] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 22:37:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 2048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 22:37:35.228089 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-8c0e3a96-e6a1-4b38-8ab1-9a253407e52f tempest-VolumesTestJSON-1206785108 tempest-VolumesTestJSON-1206785108-project] Calling method '.version_select at 0x7fc0ad1f78b0>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:35.390350 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-8c0e3a96-e6a1-4b38-8ab1-9a253407e52f tempest-VolumesTestJSON-1206785108 tempest-VolumesTestJSON-1206785108-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/6b1a5e9b-3179-4096-ab1c-881d7c013877" status: 200 len: 350 microversion: 2.1 time: 0.177876 Aug 07 22:37:35.391165 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 7/19] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 22:37:35 2022] GET /compute/v2.1/os-volumes/6b1a5e9b-3179-4096-ab1c-881d7c013877 => generated 350 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:37:35.405855 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-c5409aab-26c5-4e72-9dd1-32fe2293a591 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:35.406631 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-c5409aab-26c5-4e72-9dd1-32fe2293a591 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:35.515614 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-2e48be63-6503-4c41-b031-74a672362acd tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Action: 'create', calling method: .version_select at 0x7fc0ad212c10>, body: {"keypair": {"name": "tempest-keypair-2009987897", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0a6DSdb9hgUK0vgFvtD/LAopFYe+QzxYB/qwHIht3ftjYyqAmjmJZqfnbKxWph4d96FB5KzG5gAA/tXGdU5b1j6utJ9P9MqfP3DfucvzabLAZ/VPiqucXVzsetrBVe2Q=="}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:37:35.611524 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-2e48be63-6503-4c41-b031-74a672362acd tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Getting quotas for project 3f7ea2694e7641088d957060a1001d86. Resources: {'key_pairs'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:37:35.624536 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-2e48be63-6503-4c41-b031-74a672362acd tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Getting quotas for user 05ef5ec6afb84c4abc0cb4862f041dd1 and project 3f7ea2694e7641088d957060a1001d86. Resources: {'key_pairs'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:37:35.715412 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-c5409aab-26c5-4e72-9dd1-32fe2293a591 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:35.732554 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-c5409aab-26c5-4e72-9dd1-32fe2293a591 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1214 microversion: 2.1 time: 0.330869 Aug 07 22:37:35.733724 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 8/20] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:35 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1214 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:35.763370 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-858481ec-4df7-4845-b050-8f407bc8963f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:35.765117 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-858481ec-4df7-4845-b050-8f407bc8963f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:35.849325 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-2e48be63-6503-4c41-b031-74a672362acd tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.950749 Aug 07 22:37:35.851361 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 13/21] 10.222.0.30 () {62 vars in 1200 bytes} [Sun Aug 7 22:37:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 955 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 07 22:37:35.908663 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-858481ec-4df7-4845-b050-8f407bc8963f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:35.918263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-858481ec-4df7-4845-b050-8f407bc8963f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1221 microversion: 2.1 time: 0.183430 Aug 07 22:37:35.918842 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 9/22] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:35 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1221 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:36.252140 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-49ca8b4d-1039-44f4-b4d0-4a557611cc17 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-904031667", "imageRef": "91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:37:36.429196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.network.neutron [None req-49ca8b4d-1039-44f4-b4d0-4a557611cc17 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] validate_networks() for [('b379400c-91c0-4503-ac16-d8b7f1c793d1', None, None, None, None, None)] {{(pid=129964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 22:37:36.760201 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-8be07677-9574-4261-afa9-9551b62306e5 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:36.761033 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-8be07677-9574-4261-afa9-9551b62306e5 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:36.989400 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8be07677-9574-4261-afa9-9551b62306e5 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:37.012242 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-8be07677-9574-4261-afa9-9551b62306e5 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1214 microversion: 2.1 time: 0.247043 Aug 07 22:37:37.027772 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 10/23] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:36 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1214 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:37.337460 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-49ca8b4d-1039-44f4-b4d0-4a557611cc17 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Flavor limits 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 22:37:37.338946 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-49ca8b4d-1039-44f4-b4d0-4a557611cc17 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Image limits 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 22:37:37.339639 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-49ca8b4d-1039-44f4-b4d0-4a557611cc17 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Flavor pref 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 22:37:37.340352 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-49ca8b4d-1039-44f4-b4d0-4a557611cc17 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Image pref 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 22:37:37.341241 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-49ca8b4d-1039-44f4-b4d0-4a557611cc17 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 22:37:37.358403 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-49ca8b4d-1039-44f4-b4d0-4a557611cc17 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:37.359007 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-49ca8b4d-1039-44f4-b4d0-4a557611cc17 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:37.359550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-49ca8b4d-1039-44f4-b4d0-4a557611cc17 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:37.360924 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-49ca8b4d-1039-44f4-b4d0-4a557611cc17 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:37.361882 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-49ca8b4d-1039-44f4-b4d0-4a557611cc17 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:37.362600 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-49ca8b4d-1039-44f4-b4d0-4a557611cc17 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:37.401849 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-49ca8b4d-1039-44f4-b4d0-4a557611cc17 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Getting quotas for project 1a78ad9d7151473798fbefa330678250. Resources: {'cores', 'instances', 'ram'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:37:37.407527 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-49ca8b4d-1039-44f4-b4d0-4a557611cc17 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Getting quotas for user 966045fbe69f43b4b1a825da3ad571b9 and project 1a78ad9d7151473798fbefa330678250. Resources: {'cores', 'instances', 'ram'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:37:37.418557 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-49ca8b4d-1039-44f4-b4d0-4a557611cc17 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Going to run 1 instances... {{(pid=129964) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 22:37:37.420817 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-49ca8b4d-1039-44f4-b4d0-4a557611cc17 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 22:37:37.647740 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-49ca8b4d-1039-44f4-b4d0-4a557611cc17 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.400627 Aug 07 22:37:37.654227 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 14/24] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 22:37:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 1407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 22:37:37.671942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7703a8fd-3bab-4400-9004-32e96f9b528e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:37.672649 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-7703a8fd-3bab-4400-9004-32e96f9b528e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:37.673001 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-1decb752-2ee0-476d-b7de-bf84a7f9f402 tempest-VolumesTestJSON-1206785108 tempest-VolumesTestJSON-1206785108-project] Calling method '.version_select at 0x7fc0ad22a9d0>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:37.823599 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7703a8fd-3bab-4400-9004-32e96f9b528e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:37.831856 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-7703a8fd-3bab-4400-9004-32e96f9b528e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1221 microversion: 2.1 time: 0.173617 Aug 07 22:37:37.838172 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 11/25] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:37 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1221 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:37.904189 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-1decb752-2ee0-476d-b7de-bf84a7f9f402 tempest-VolumesTestJSON-1206785108 tempest-VolumesTestJSON-1206785108-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/f52624ed-d584-4741-93a2-b094bef1b36f" status: 200 len: 350 microversion: 2.1 time: 0.243251 Aug 07 22:37:37.904902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 15/26] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 22:37:37 2022] GET /compute/v2.1/os-volumes/f52624ed-d584-4741-93a2-b094bef1b36f => generated 350 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:37:37.919317 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-a5cd8236-ed9f-4bc7-b2c7-0e2a40b527e6 tempest-VolumesTestJSON-1206785108 tempest-VolumesTestJSON-1206785108-project] Calling method '.version_select at 0x7fc0ad1f7700>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:38.034583 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-5f587352-8882-428b-bb10-30e0cffc5e02 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:38.035282 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-5f587352-8882-428b-bb10-30e0cffc5e02 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:38.106919 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5f587352-8882-428b-bb10-30e0cffc5e02 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:38.108532 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5f587352-8882-428b-bb10-30e0cffc5e02 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:38.110544 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5f587352-8882-428b-bb10-30e0cffc5e02 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:38.118022 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5f587352-8882-428b-bb10-30e0cffc5e02 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:38.121836 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5f587352-8882-428b-bb10-30e0cffc5e02 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:38.124983 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5f587352-8882-428b-bb10-30e0cffc5e02 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:38.335880 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-a5cd8236-ed9f-4bc7-b2c7-0e2a40b527e6 tempest-VolumesTestJSON-1206785108 tempest-VolumesTestJSON-1206785108-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.421540 Aug 07 22:37:38.337526 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 12/27] 10.222.0.30 () {58 vars in 1134 bytes} [Sun Aug 7 22:37:37 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:38.360806 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-1af5aab0-98a1-4a4a-a683-922a45d2bab7 tempest-VolumesTestJSON-1206785108 tempest-VolumesTestJSON-1206785108-project] Calling method '.version_select at 0x7fc0ac9c6790>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:38.625100 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-5f587352-8882-428b-bb10-30e0cffc5e02 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:38.682895 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-5f587352-8882-428b-bb10-30e0cffc5e02 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1218 microversion: 2.1 time: 0.652050 Aug 07 22:37:38.684366 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 16/28] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:38 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1218 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:37:38.786449 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-1af5aab0-98a1-4a4a-a683-922a45d2bab7 tempest-VolumesTestJSON-1206785108 tempest-VolumesTestJSON-1206785108-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.437751 Aug 07 22:37:38.787042 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 13/29] 10.222.0.30 () {58 vars in 1149 bytes} [Sun Aug 7 22:37:38 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:37:38.801526 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-9c49eb02-96f6-496a-9594-aacf51bb5aeb tempest-VolumesTestJSON-1206785108 tempest-VolumesTestJSON-1206785108-project] Calling method '.version_select at 0x7fc0ac1551f0>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:38.855335 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-a7f108e5-d9cd-40c2-ab57-b0f131bd0eba tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:38.856453 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-a7f108e5-d9cd-40c2-ab57-b0f131bd0eba tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:38.985569 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-a7f108e5-d9cd-40c2-ab57-b0f131bd0eba tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:38.993118 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-a7f108e5-d9cd-40c2-ab57-b0f131bd0eba tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1221 microversion: 2.1 time: 0.142078 Aug 07 22:37:38.996291 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 14/30] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:38 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1221 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:39.095439 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-9c49eb02-96f6-496a-9594-aacf51bb5aeb tempest-VolumesTestJSON-1206785108 tempest-VolumesTestJSON-1206785108-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.298405 Aug 07 22:37:39.096771 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 17/31] 10.222.0.30 () {58 vars in 1134 bytes} [Sun Aug 7 22:37:38 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:39.113255 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-30db76ef-3783-4ebd-ae5c-25619dc0c44b tempest-VolumesTestJSON-1206785108 tempest-VolumesTestJSON-1206785108-project] Calling method '.version_select at 0x7fc0ac9b7790>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:39.322263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-30db76ef-3783-4ebd-ae5c-25619dc0c44b tempest-VolumesTestJSON-1206785108 tempest-VolumesTestJSON-1206785108-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.215290 Aug 07 22:37:39.322992 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 15/32] 10.222.0.30 () {58 vars in 1167 bytes} [Sun Aug 7 22:37:39 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:37:39.340131 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-07c04034-eeed-4b1e-8bde-26c3bc33427e tempest-VolumesTestJSON-1206785108 tempest-VolumesTestJSON-1206785108-project] Calling method '.version_select at 0x7fc0ac17f0d0>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:39.543977 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-07c04034-eeed-4b1e-8bde-26c3bc33427e tempest-VolumesTestJSON-1206785108 tempest-VolumesTestJSON-1206785108-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.211573 Aug 07 22:37:39.544602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 18/33] 10.222.0.30 () {58 vars in 1170 bytes} [Sun Aug 7 22:37:39 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:37:39.560368 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-cc124af2-fcc4-4686-a6e3-c7e17317472e tempest-VolumesTestJSON-1206785108 tempest-VolumesTestJSON-1206785108-project] Calling method '.version_select at 0x7fc0ac9c5550>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:39.715188 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-14ce9fb9-5a69-4527-ab5c-7b89d2a3e925 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:39.715809 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-14ce9fb9-5a69-4527-ab5c-7b89d2a3e925 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:39.732155 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-14ce9fb9-5a69-4527-ab5c-7b89d2a3e925 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:39.734739 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-14ce9fb9-5a69-4527-ab5c-7b89d2a3e925 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:39.734739 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-14ce9fb9-5a69-4527-ab5c-7b89d2a3e925 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:39.734739 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-14ce9fb9-5a69-4527-ab5c-7b89d2a3e925 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:39.735517 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-14ce9fb9-5a69-4527-ab5c-7b89d2a3e925 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:39.736146 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-14ce9fb9-5a69-4527-ab5c-7b89d2a3e925 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:39.787056 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-cc124af2-fcc4-4686-a6e3-c7e17317472e tempest-VolumesTestJSON-1206785108 tempest-VolumesTestJSON-1206785108-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.230599 Aug 07 22:37:39.788118 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 16/34] 10.222.0.30 () {58 vars in 1155 bytes} [Sun Aug 7 22:37:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:39.801804 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-e649d172-e692-4a37-be30-2e02798e5a99 tempest-VolumesTestJSON-1206785108 tempest-VolumesTestJSON-1206785108-project] Calling method '.version_select at 0x7fc0ac9b7790>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:39.919683 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-14ce9fb9-5a69-4527-ab5c-7b89d2a3e925 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:39.928820 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-14ce9fb9-5a69-4527-ab5c-7b89d2a3e925 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1266 microversion: 2.1 time: 0.223831 Aug 07 22:37:39.932469 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 19/35] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:39 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:40.021401 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-4b8dd448-fb3a-49aa-b677-10e5e66fb711 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:40.022245 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-4b8dd448-fb3a-49aa-b677-10e5e66fb711 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:40.044424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4b8dd448-fb3a-49aa-b677-10e5e66fb711 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:40.045068 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4b8dd448-fb3a-49aa-b677-10e5e66fb711 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:40.048361 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4b8dd448-fb3a-49aa-b677-10e5e66fb711 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:40.071563 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4b8dd448-fb3a-49aa-b677-10e5e66fb711 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:40.073298 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4b8dd448-fb3a-49aa-b677-10e5e66fb711 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:40.073938 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4b8dd448-fb3a-49aa-b677-10e5e66fb711 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:40.109264 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-e649d172-e692-4a37-be30-2e02798e5a99 tempest-VolumesTestJSON-1206785108 tempest-VolumesTestJSON-1206785108-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.311647 Aug 07 22:37:40.109855 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 17/36] 10.222.0.30 () {58 vars in 1188 bytes} [Sun Aug 7 22:37:39 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:37:40.126110 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-e7109692-5cfe-4dc8-bc38-70ddd04ee296 tempest-VolumesTestJSON-1206785108 tempest-VolumesTestJSON-1206785108-project] Calling method '.version_select at 0x7fc0ac9c54c0>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:40.290319 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-4b8dd448-fb3a-49aa-b677-10e5e66fb711 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:40.300875 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-4b8dd448-fb3a-49aa-b677-10e5e66fb711 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1225 microversion: 2.1 time: 0.282765 Aug 07 22:37:40.301974 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 20/37] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:40 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1225 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:40.361942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-e7109692-5cfe-4dc8-bc38-70ddd04ee296 tempest-VolumesTestJSON-1206785108 tempest-VolumesTestJSON-1206785108-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.241508 Aug 07 22:37:40.362509 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 18/38] 10.222.0.30 () {58 vars in 1155 bytes} [Sun Aug 7 22:37:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:40.956113 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-bc413636-fd65-4f60-997a-563df09ba83f tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:40.956929 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-bc413636-fd65-4f60-997a-563df09ba83f tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:40.966938 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bc413636-fd65-4f60-997a-563df09ba83f tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:40.967435 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bc413636-fd65-4f60-997a-563df09ba83f tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:40.978285 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bc413636-fd65-4f60-997a-563df09ba83f tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:40.980974 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bc413636-fd65-4f60-997a-563df09ba83f tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:40.981477 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bc413636-fd65-4f60-997a-563df09ba83f tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:40.981930 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bc413636-fd65-4f60-997a-563df09ba83f tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:41.311906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-bc413636-fd65-4f60-997a-563df09ba83f tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:41.324214 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-a8d97ab9-3f0e-41ff-a858-fe850824de86 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:41.325008 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-a8d97ab9-3f0e-41ff-a858-fe850824de86 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:41.333733 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a8d97ab9-3f0e-41ff-a858-fe850824de86 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:41.345129 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a8d97ab9-3f0e-41ff-a858-fe850824de86 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:41.345927 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a8d97ab9-3f0e-41ff-a858-fe850824de86 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:41.346826 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a8d97ab9-3f0e-41ff-a858-fe850824de86 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:41.346940 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-bc413636-fd65-4f60-997a-563df09ba83f tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1284 microversion: 2.1 time: 0.393416 Aug 07 22:37:41.347916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 21/39] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:40 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1284 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:41.348824 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a8d97ab9-3f0e-41ff-a858-fe850824de86 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:41.350452 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a8d97ab9-3f0e-41ff-a858-fe850824de86 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:41.672345 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-a8d97ab9-3f0e-41ff-a858-fe850824de86 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:41.698513 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-a8d97ab9-3f0e-41ff-a858-fe850824de86 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1273 microversion: 2.1 time: 0.378584 Aug 07 22:37:41.724805 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 19/40] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:41 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1273 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:37:41.765878 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-1ed79f9d-08ab-4e56-93f0-1ce301eaf5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1022678776", "imageRef": "91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "057d9455-09f9-43b3-b9b9-43213b4e9159"}], "security_groups": [{"name": "tempest-securitygroup--908637909"}], "key_name": "tempest-keypair-2009987897", "user_data": "}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:37:42.341847 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.network.neutron [None req-1ed79f9d-08ab-4e56-93f0-1ce301eaf5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] validate_networks() for [('057d9455-09f9-43b3-b9b9-43213b4e9159', None, None, None, None, None)] {{(pid=129964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 22:37:42.373050 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-73ac59c8-ffa8-472b-9da2-a459b01426b4 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:42.373676 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-73ac59c8-ffa8-472b-9da2-a459b01426b4 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:42.381866 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-73ac59c8-ffa8-472b-9da2-a459b01426b4 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:42.382900 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-73ac59c8-ffa8-472b-9da2-a459b01426b4 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:42.384353 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-73ac59c8-ffa8-472b-9da2-a459b01426b4 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:42.385372 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-73ac59c8-ffa8-472b-9da2-a459b01426b4 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:42.385996 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-73ac59c8-ffa8-472b-9da2-a459b01426b4 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:42.386425 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-73ac59c8-ffa8-472b-9da2-a459b01426b4 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:42.947442 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-73ac59c8-ffa8-472b-9da2-a459b01426b4 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:42.964450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-73ac59c8-ffa8-472b-9da2-a459b01426b4 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.595204 Aug 07 22:37:42.967406 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 20/41] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:42 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:37:42.986923 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-62126a61-6a73-4972-b458-e1741cd05ef1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:42.993918 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-62126a61-6a73-4972-b458-e1741cd05ef1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:43.005336 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-62126a61-6a73-4972-b458-e1741cd05ef1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:43.005828 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-62126a61-6a73-4972-b458-e1741cd05ef1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:43.007589 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-62126a61-6a73-4972-b458-e1741cd05ef1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:43.009220 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-62126a61-6a73-4972-b458-e1741cd05ef1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:43.009672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-62126a61-6a73-4972-b458-e1741cd05ef1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:43.010101 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-62126a61-6a73-4972-b458-e1741cd05ef1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:43.609988 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-62126a61-6a73-4972-b458-e1741cd05ef1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:43.623601 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-62126a61-6a73-4972-b458-e1741cd05ef1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1279 microversion: 2.1 time: 0.654476 Aug 07 22:37:43.649017 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 21/42] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:42 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1279 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:43.990641 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-1b66d2ef-bbd2-4607-bdbd-229443347ffb tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:43.993784 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-1b66d2ef-bbd2-4607-bdbd-229443347ffb tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:44.010494 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1b66d2ef-bbd2-4607-bdbd-229443347ffb tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:44.010999 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1b66d2ef-bbd2-4607-bdbd-229443347ffb tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:44.011447 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1b66d2ef-bbd2-4607-bdbd-229443347ffb tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:44.020297 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1b66d2ef-bbd2-4607-bdbd-229443347ffb tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:44.024080 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1b66d2ef-bbd2-4607-bdbd-229443347ffb tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:44.025171 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1b66d2ef-bbd2-4607-bdbd-229443347ffb tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:44.746468 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-1ed79f9d-08ab-4e56-93f0-1ce301eaf5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Flavor limits 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 22:37:44.747991 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-1ed79f9d-08ab-4e56-93f0-1ce301eaf5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Image limits 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 22:37:44.750153 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-1ed79f9d-08ab-4e56-93f0-1ce301eaf5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Flavor pref 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 22:37:44.753974 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-1ed79f9d-08ab-4e56-93f0-1ce301eaf5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Image pref 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 22:37:44.759501 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-1ed79f9d-08ab-4e56-93f0-1ce301eaf5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 22:37:44.796649 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1ed79f9d-08ab-4e56-93f0-1ce301eaf5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:44.799632 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1ed79f9d-08ab-4e56-93f0-1ce301eaf5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:44.803984 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1ed79f9d-08ab-4e56-93f0-1ce301eaf5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:44.810985 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1ed79f9d-08ab-4e56-93f0-1ce301eaf5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:44.814129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1ed79f9d-08ab-4e56-93f0-1ce301eaf5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:44.816941 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1ed79f9d-08ab-4e56-93f0-1ce301eaf5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:44.842296 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=2 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:37:44.857170 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-1ed79f9d-08ab-4e56-93f0-1ce301eaf5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Getting quotas for project 3f7ea2694e7641088d957060a1001d86. Resources: {'cores', 'instances', 'ram'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:37:44.870019 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-1ed79f9d-08ab-4e56-93f0-1ce301eaf5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Getting quotas for user 05ef5ec6afb84c4abc0cb4862f041dd1 and project 3f7ea2694e7641088d957060a1001d86. Resources: {'cores', 'instances', 'ram'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:37:44.912809 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-1ed79f9d-08ab-4e56-93f0-1ce301eaf5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Going to run 1 instances... {{(pid=129964) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 22:37:44.913345 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-1ed79f9d-08ab-4e56-93f0-1ce301eaf5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 22:37:45.088831 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-1ed79f9d-08ab-4e56-93f0-1ce301eaf5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.327613 Aug 07 22:37:45.097572 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 22/43] 10.222.0.30 () {62 vars in 1188 bytes} [Sun Aug 7 22:37:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 3337 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 07 22:37:45.108380 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-0ae40031-682a-45f3-aaf5-ac316b96b1d8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:45.113351 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-0ae40031-682a-45f3-aaf5-ac316b96b1d8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:45.119215 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0ae40031-682a-45f3-aaf5-ac316b96b1d8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:45.120281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0ae40031-682a-45f3-aaf5-ac316b96b1d8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:45.121265 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0ae40031-682a-45f3-aaf5-ac316b96b1d8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:45.122466 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0ae40031-682a-45f3-aaf5-ac316b96b1d8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:45.123600 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0ae40031-682a-45f3-aaf5-ac316b96b1d8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:45.142943 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0ae40031-682a-45f3-aaf5-ac316b96b1d8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:45.211168 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-1b66d2ef-bbd2-4607-bdbd-229443347ffb tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:45.224882 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-1b66d2ef-bbd2-4607-bdbd-229443347ffb tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 1.239839 Aug 07 22:37:45.247094 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 22/44] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:43 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:37:45.276464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-95a7284c-d37a-4450-b568-bfbaaa65e4ae tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:45.276464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-95a7284c-d37a-4450-b568-bfbaaa65e4ae tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:45.662722 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-95a7284c-d37a-4450-b568-bfbaaa65e4ae tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:45.674717 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-95a7284c-d37a-4450-b568-bfbaaa65e4ae tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:45.676348 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-95a7284c-d37a-4450-b568-bfbaaa65e4ae tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:45.681965 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-95a7284c-d37a-4450-b568-bfbaaa65e4ae tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1282 microversion: 2.20 time: 0.433609 Aug 07 22:37:45.684641 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 23/45] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:37:45 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1282 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:37:45.908761 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-8bf55bdd-6839-4eae-ae27-4ccf9d989a3a req-018ce5dc-5de1-4c7a-8d7f-c02611de94ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e2c1f8-3d85-437e-9c51-805820cfa4a7", "tag": "ee8dc2da-5ffd-43e1-a446-69c9b4634a95"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:37:45.928461 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-8bf55bdd-6839-4eae-ae27-4ccf9d989a3a req-018ce5dc-5de1-4c7a-8d7f-c02611de94ec service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:45.929030 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-8bf55bdd-6839-4eae-ae27-4ccf9d989a3a req-018ce5dc-5de1-4c7a-8d7f-c02611de94ec service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:45.929470 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-8bf55bdd-6839-4eae-ae27-4ccf9d989a3a req-018ce5dc-5de1-4c7a-8d7f-c02611de94ec service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:45.991185 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-8bf55bdd-6839-4eae-ae27-4ccf9d989a3a req-018ce5dc-5de1-4c7a-8d7f-c02611de94ec service nova] Creating event network-changed:ee8dc2da-5ffd-43e1-a446-69c9b4634a95 for instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 on hv-cinder-85032 Aug 07 22:37:45.994287 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-8bf55bdd-6839-4eae-ae27-4ccf9d989a3a req-018ce5dc-5de1-4c7a-8d7f-c02611de94ec service nova] Acquiring lock "compute-rpcapi-router" {{(pid=129965) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 07 22:37:45.994778 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-8bf55bdd-6839-4eae-ae27-4ccf9d989a3a req-018ce5dc-5de1-4c7a-8d7f-c02611de94ec service nova] Acquired lock "compute-rpcapi-router" {{(pid=129965) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 07 22:37:45.997691 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-69afc91c-b0a0-4b35-a8ce-ed44bda3b511 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:45.999196 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-69afc91c-b0a0-4b35-a8ce-ed44bda3b511 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:45.999731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-69afc91c-b0a0-4b35-a8ce-ed44bda3b511 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:46.001636 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-69afc91c-b0a0-4b35-a8ce-ed44bda3b511 None None] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:46.002838 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-69afc91c-b0a0-4b35-a8ce-ed44bda3b511 None None] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:46.017468 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-69afc91c-b0a0-4b35-a8ce-ed44bda3b511 None None] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:46.051150 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-0ae40031-682a-45f3-aaf5-ac316b96b1d8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:46.051752 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.compute.rpcapi [None req-69afc91c-b0a0-4b35-a8ce-ed44bda3b511 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 07 22:37:46.051752 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-69afc91c-b0a0-4b35-a8ce-ed44bda3b511 None None] Releasing lock "compute-rpcapi-router" {{(pid=129965) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 07 22:37:46.060340 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-0ae40031-682a-45f3-aaf5-ac316b96b1d8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.958880 Aug 07 22:37:46.060996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 23/46] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:45 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:46.100505 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-69afc91c-b0a0-4b35-a8ce-ed44bda3b511 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.353608 Aug 07 22:37:46.100505 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 24/47] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:37:46.261109 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-356b05a4-b9d2-4c3b-8698-df602647e8cb tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:46.271350 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-356b05a4-b9d2-4c3b-8698-df602647e8cb tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:46.281557 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-356b05a4-b9d2-4c3b-8698-df602647e8cb tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:46.283877 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-356b05a4-b9d2-4c3b-8698-df602647e8cb tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:46.286159 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-356b05a4-b9d2-4c3b-8698-df602647e8cb tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:46.288512 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-356b05a4-b9d2-4c3b-8698-df602647e8cb tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:46.291398 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-356b05a4-b9d2-4c3b-8698-df602647e8cb tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:46.292240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-356b05a4-b9d2-4c3b-8698-df602647e8cb tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:46.713728 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-e37f3672-e65d-40da-87a9-5123842209a0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:46.715121 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-e37f3672-e65d-40da-87a9-5123842209a0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:46.735940 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-356b05a4-b9d2-4c3b-8698-df602647e8cb tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:46.759180 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-356b05a4-b9d2-4c3b-8698-df602647e8cb tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.499344 Aug 07 22:37:46.759180 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 24/48] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:46 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:47.083564 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-ab6235e0-f5e6-4afb-9913-626b0e5a49b1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:47.084415 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-ab6235e0-f5e6-4afb-9913-626b0e5a49b1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:47.093013 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ab6235e0-f5e6-4afb-9913-626b0e5a49b1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:47.093821 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ab6235e0-f5e6-4afb-9913-626b0e5a49b1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:47.094625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ab6235e0-f5e6-4afb-9913-626b0e5a49b1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:47.095626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ab6235e0-f5e6-4afb-9913-626b0e5a49b1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:47.096322 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ab6235e0-f5e6-4afb-9913-626b0e5a49b1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:47.096942 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ab6235e0-f5e6-4afb-9913-626b0e5a49b1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:47.164079 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-e37f3672-e65d-40da-87a9-5123842209a0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:47.177171 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-e37f3672-e65d-40da-87a9-5123842209a0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:47.180344 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-e37f3672-e65d-40da-87a9-5123842209a0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:47.186682 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-e37f3672-e65d-40da-87a9-5123842209a0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1282 microversion: 2.20 time: 0.476969 Aug 07 22:37:47.218644 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 25/49] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:37:46 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1282 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:37:47.577773 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-ab6235e0-f5e6-4afb-9913-626b0e5a49b1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:47.593354 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-ab6235e0-f5e6-4afb-9913-626b0e5a49b1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.515076 Aug 07 22:37:47.594360 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 25/50] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:47 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:47.785209 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-6040be73-ec81-446c-9c39-55ebe57851cd tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:47.793488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-6040be73-ec81-446c-9c39-55ebe57851cd tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:47.833896 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6040be73-ec81-446c-9c39-55ebe57851cd tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:47.837289 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6040be73-ec81-446c-9c39-55ebe57851cd tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:47.847622 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6040be73-ec81-446c-9c39-55ebe57851cd tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:47.851024 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6040be73-ec81-446c-9c39-55ebe57851cd tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:47.851024 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6040be73-ec81-446c-9c39-55ebe57851cd tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:47.851024 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6040be73-ec81-446c-9c39-55ebe57851cd tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:47.932393 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-17fc8817-8ad9-42ac-ad35-c0dd14a97460 req-f8e4d76d-68f5-4bd1-acc9-ec334d108854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e", "tag": "8844e27d-a856-4256-bdd2-6ab7f2b8ceda"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:37:47.983699 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-17fc8817-8ad9-42ac-ad35-c0dd14a97460 req-f8e4d76d-68f5-4bd1-acc9-ec334d108854 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:47.985023 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-17fc8817-8ad9-42ac-ad35-c0dd14a97460 req-f8e4d76d-68f5-4bd1-acc9-ec334d108854 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:47.988618 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-17fc8817-8ad9-42ac-ad35-c0dd14a97460 req-f8e4d76d-68f5-4bd1-acc9-ec334d108854 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:48.036177 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-17fc8817-8ad9-42ac-ad35-c0dd14a97460 req-f8e4d76d-68f5-4bd1-acc9-ec334d108854 service nova] Creating event network-changed:8844e27d-a856-4256-bdd2-6ab7f2b8ceda for instance c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e on hv-cinder-85032 Aug 07 22:37:48.052173 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-17fc8817-8ad9-42ac-ad35-c0dd14a97460 req-f8e4d76d-68f5-4bd1-acc9-ec334d108854 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.300376 Aug 07 22:37:48.055375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 26/51] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:37:48.220115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-b0b16d68-66a0-40d5-930f-68190ccdf70e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:48.221144 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-b0b16d68-66a0-40d5-930f-68190ccdf70e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:48.269848 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b0b16d68-66a0-40d5-930f-68190ccdf70e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:48.276239 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b0b16d68-66a0-40d5-930f-68190ccdf70e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:48.277081 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b0b16d68-66a0-40d5-930f-68190ccdf70e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:48.279686 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b0b16d68-66a0-40d5-930f-68190ccdf70e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:48.287049 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b0b16d68-66a0-40d5-930f-68190ccdf70e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:48.287901 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b0b16d68-66a0-40d5-930f-68190ccdf70e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:48.418614 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-b0b16d68-66a0-40d5-930f-68190ccdf70e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:48.436051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-b0b16d68-66a0-40d5-930f-68190ccdf70e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:48.436051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-b0b16d68-66a0-40d5-930f-68190ccdf70e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:48.436051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-b0b16d68-66a0-40d5-930f-68190ccdf70e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1278 microversion: 2.20 time: 0.222027 Aug 07 22:37:48.437877 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:37:48 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1278 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:37:48.483968 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-6040be73-ec81-446c-9c39-55ebe57851cd tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:48.491451 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-6040be73-ec81-446c-9c39-55ebe57851cd tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.715504 Aug 07 22:37:48.493282 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 26/53] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:47 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:48.620141 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-f4899039-067e-472c-b88f-ce4b430bff7a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:48.620141 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-f4899039-067e-472c-b88f-ce4b430bff7a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:48.623483 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f4899039-067e-472c-b88f-ce4b430bff7a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:48.624081 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f4899039-067e-472c-b88f-ce4b430bff7a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:48.624585 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f4899039-067e-472c-b88f-ce4b430bff7a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:48.625396 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f4899039-067e-472c-b88f-ce4b430bff7a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:48.625893 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f4899039-067e-472c-b88f-ce4b430bff7a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:48.626320 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f4899039-067e-472c-b88f-ce4b430bff7a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:48.799497 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f4899039-067e-472c-b88f-ce4b430bff7a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:48.810156 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-f4899039-067e-472c-b88f-ce4b430bff7a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.198895 Aug 07 22:37:48.818192 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 28/54] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:48 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:49.480755 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b6a62473-8d45-4e9e-89d6-3b52a97ee368 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:49.481415 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-b6a62473-8d45-4e9e-89d6-3b52a97ee368 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:49.488581 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b6a62473-8d45-4e9e-89d6-3b52a97ee368 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:49.489724 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b6a62473-8d45-4e9e-89d6-3b52a97ee368 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:49.490664 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b6a62473-8d45-4e9e-89d6-3b52a97ee368 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:49.491536 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b6a62473-8d45-4e9e-89d6-3b52a97ee368 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:49.492787 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b6a62473-8d45-4e9e-89d6-3b52a97ee368 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:49.493406 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b6a62473-8d45-4e9e-89d6-3b52a97ee368 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:49.516399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-9fbfbcc4-3e3c-444e-888e-9d0ec61ec298 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:49.523927 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-9fbfbcc4-3e3c-444e-888e-9d0ec61ec298 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:49.523927 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9fbfbcc4-3e3c-444e-888e-9d0ec61ec298 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:49.523927 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9fbfbcc4-3e3c-444e-888e-9d0ec61ec298 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:49.524458 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9fbfbcc4-3e3c-444e-888e-9d0ec61ec298 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:49.525118 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9fbfbcc4-3e3c-444e-888e-9d0ec61ec298 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:49.525781 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9fbfbcc4-3e3c-444e-888e-9d0ec61ec298 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:49.526191 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9fbfbcc4-3e3c-444e-888e-9d0ec61ec298 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:49.560727 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-b6a62473-8d45-4e9e-89d6-3b52a97ee368 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:49.568729 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-b6a62473-8d45-4e9e-89d6-3b52a97ee368 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:49.570403 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-b6a62473-8d45-4e9e-89d6-3b52a97ee368 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:49.571707 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-b6a62473-8d45-4e9e-89d6-3b52a97ee368 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1278 microversion: 2.20 time: 0.095680 Aug 07 22:37:49.572296 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 27/55] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:37:49 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1278 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:37:49.662435 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-9fbfbcc4-3e3c-444e-888e-9d0ec61ec298 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:49.670822 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-9fbfbcc4-3e3c-444e-888e-9d0ec61ec298 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.161065 Aug 07 22:37:49.672930 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 29/56] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:49 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:49.833046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-6f7cfc7e-55f8-4316-b2ca-be8faf05e912 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:49.833656 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-6f7cfc7e-55f8-4316-b2ca-be8faf05e912 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:49.840475 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6f7cfc7e-55f8-4316-b2ca-be8faf05e912 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:49.840955 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6f7cfc7e-55f8-4316-b2ca-be8faf05e912 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:49.841420 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6f7cfc7e-55f8-4316-b2ca-be8faf05e912 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:49.842296 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6f7cfc7e-55f8-4316-b2ca-be8faf05e912 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:49.842724 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6f7cfc7e-55f8-4316-b2ca-be8faf05e912 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:49.843149 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6f7cfc7e-55f8-4316-b2ca-be8faf05e912 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:49.990547 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-6f7cfc7e-55f8-4316-b2ca-be8faf05e912 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:49.990547 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-6f7cfc7e-55f8-4316-b2ca-be8faf05e912 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.160641 Aug 07 22:37:49.990547 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 28/57] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:49 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:50.193909 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-e5479be3-3578-405e-a73d-f925f547eba0 req-a6f05c33-6b5e-4c85-85a5-54736d1a387e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39340b52-40cd-4de1-a055-2ad5d71a6598", "tag": "3ebb913e-d05d-414e-9214-6fe46a403f13"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:37:50.203689 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-e5479be3-3578-405e-a73d-f925f547eba0 req-a6f05c33-6b5e-4c85-85a5-54736d1a387e service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:50.204196 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-e5479be3-3578-405e-a73d-f925f547eba0 req-a6f05c33-6b5e-4c85-85a5-54736d1a387e service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:50.204623 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-e5479be3-3578-405e-a73d-f925f547eba0 req-a6f05c33-6b5e-4c85-85a5-54736d1a387e service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:50.215590 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-e5479be3-3578-405e-a73d-f925f547eba0 req-a6f05c33-6b5e-4c85-85a5-54736d1a387e service nova] Creating event network-changed:3ebb913e-d05d-414e-9214-6fe46a403f13 for instance 39340b52-40cd-4de1-a055-2ad5d71a6598 on hv-cinder-85032 Aug 07 22:37:50.220870 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-e5479be3-3578-405e-a73d-f925f547eba0 req-a6f05c33-6b5e-4c85-85a5-54736d1a387e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030719 Aug 07 22:37:50.226852 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:37:50.594852 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-db3ea2ec-0cca-44f4-9fa4-7c53c12dc5e8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:50.595426 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-db3ea2ec-0cca-44f4-9fa4-7c53c12dc5e8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:50.602271 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-db3ea2ec-0cca-44f4-9fa4-7c53c12dc5e8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:50.602927 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-db3ea2ec-0cca-44f4-9fa4-7c53c12dc5e8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:50.603359 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-db3ea2ec-0cca-44f4-9fa4-7c53c12dc5e8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:50.604077 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-db3ea2ec-0cca-44f4-9fa4-7c53c12dc5e8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:50.604530 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-db3ea2ec-0cca-44f4-9fa4-7c53c12dc5e8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:50.604944 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-db3ea2ec-0cca-44f4-9fa4-7c53c12dc5e8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:50.666154 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-db3ea2ec-0cca-44f4-9fa4-7c53c12dc5e8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:50.674633 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-db3ea2ec-0cca-44f4-9fa4-7c53c12dc5e8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:50.676817 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-db3ea2ec-0cca-44f4-9fa4-7c53c12dc5e8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:50.677450 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-db3ea2ec-0cca-44f4-9fa4-7c53c12dc5e8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1278 microversion: 2.20 time: 0.086506 Aug 07 22:37:50.677929 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 29/59] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:37:50 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1278 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:37:50.693754 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-77f5cc30-5baa-4705-a251-0981429ed0ea tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:50.694486 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-77f5cc30-5baa-4705-a251-0981429ed0ea tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:50.701249 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-77f5cc30-5baa-4705-a251-0981429ed0ea tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:50.703544 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-77f5cc30-5baa-4705-a251-0981429ed0ea tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:50.703544 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-77f5cc30-5baa-4705-a251-0981429ed0ea tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:50.703544 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-77f5cc30-5baa-4705-a251-0981429ed0ea tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:50.703544 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-77f5cc30-5baa-4705-a251-0981429ed0ea tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:50.704214 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-77f5cc30-5baa-4705-a251-0981429ed0ea tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:50.838860 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-77f5cc30-5baa-4705-a251-0981429ed0ea tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:50.846417 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-77f5cc30-5baa-4705-a251-0981429ed0ea tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.156965 Aug 07 22:37:50.846976 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 31/60] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:50 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:51.019684 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-255e00b1-305a-4619-a42a-b0209ff49f2d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:51.020596 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-255e00b1-305a-4619-a42a-b0209ff49f2d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:51.027868 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-255e00b1-305a-4619-a42a-b0209ff49f2d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:51.028844 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-255e00b1-305a-4619-a42a-b0209ff49f2d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:51.029269 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-255e00b1-305a-4619-a42a-b0209ff49f2d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:51.030116 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-255e00b1-305a-4619-a42a-b0209ff49f2d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:51.030727 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-255e00b1-305a-4619-a42a-b0209ff49f2d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:51.031723 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-255e00b1-305a-4619-a42a-b0209ff49f2d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:51.271611 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-255e00b1-305a-4619-a42a-b0209ff49f2d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:51.282018 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-255e00b1-305a-4619-a42a-b0209ff49f2d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.268634 Aug 07 22:37:51.282690 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 30/61] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:51 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:51.700368 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-eaf0fd14-a5a3-4fdb-bf57-284dad77995e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:51.701690 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-eaf0fd14-a5a3-4fdb-bf57-284dad77995e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:51.709279 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-eaf0fd14-a5a3-4fdb-bf57-284dad77995e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:51.709725 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-eaf0fd14-a5a3-4fdb-bf57-284dad77995e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:51.710367 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-eaf0fd14-a5a3-4fdb-bf57-284dad77995e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:51.711792 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-eaf0fd14-a5a3-4fdb-bf57-284dad77995e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:51.712468 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-eaf0fd14-a5a3-4fdb-bf57-284dad77995e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:51.713087 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-eaf0fd14-a5a3-4fdb-bf57-284dad77995e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:51.810851 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-eaf0fd14-a5a3-4fdb-bf57-284dad77995e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:51.823185 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-eaf0fd14-a5a3-4fdb-bf57-284dad77995e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:51.825378 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-eaf0fd14-a5a3-4fdb-bf57-284dad77995e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:51.826863 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-eaf0fd14-a5a3-4fdb-bf57-284dad77995e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1278 microversion: 2.20 time: 0.130530 Aug 07 22:37:51.827429 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:37:51 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1278 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:37:51.868682 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b87275de-6278-4982-9410-2bd4eed80cbd tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:51.869567 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-b87275de-6278-4982-9410-2bd4eed80cbd tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:51.877158 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b87275de-6278-4982-9410-2bd4eed80cbd tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:51.877641 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b87275de-6278-4982-9410-2bd4eed80cbd tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:51.878110 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b87275de-6278-4982-9410-2bd4eed80cbd tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:51.878806 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b87275de-6278-4982-9410-2bd4eed80cbd tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:51.879442 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b87275de-6278-4982-9410-2bd4eed80cbd tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:51.880152 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b87275de-6278-4982-9410-2bd4eed80cbd tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:52.048957 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-b87275de-6278-4982-9410-2bd4eed80cbd tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:52.057664 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-b87275de-6278-4982-9410-2bd4eed80cbd tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.194094 Aug 07 22:37:52.060164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 31/63] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:51 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:52.304140 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-aa76472c-00f2-4659-8761-a58e56a14ec5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:52.305374 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-aa76472c-00f2-4659-8761-a58e56a14ec5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:52.324479 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-aa76472c-00f2-4659-8761-a58e56a14ec5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:52.324479 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-aa76472c-00f2-4659-8761-a58e56a14ec5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:52.324479 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-aa76472c-00f2-4659-8761-a58e56a14ec5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:52.324479 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-aa76472c-00f2-4659-8761-a58e56a14ec5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:52.324802 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-aa76472c-00f2-4659-8761-a58e56a14ec5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:52.324923 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-aa76472c-00f2-4659-8761-a58e56a14ec5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:52.575498 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-aa76472c-00f2-4659-8761-a58e56a14ec5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:52.590739 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-aa76472c-00f2-4659-8761-a58e56a14ec5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.290909 Aug 07 22:37:52.605880 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 33/64] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:52 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:52.855839 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-c68beaa4-15e6-42b8-b815-d99f1e5af44e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:52.855839 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-c68beaa4-15e6-42b8-b815-d99f1e5af44e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:52.862253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c68beaa4-15e6-42b8-b815-d99f1e5af44e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:52.863477 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c68beaa4-15e6-42b8-b815-d99f1e5af44e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:52.864428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c68beaa4-15e6-42b8-b815-d99f1e5af44e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:52.865419 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c68beaa4-15e6-42b8-b815-d99f1e5af44e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:52.866164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c68beaa4-15e6-42b8-b815-d99f1e5af44e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:52.866730 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c68beaa4-15e6-42b8-b815-d99f1e5af44e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:52.978266 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-c68beaa4-15e6-42b8-b815-d99f1e5af44e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:52.983743 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-c68beaa4-15e6-42b8-b815-d99f1e5af44e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:52.985424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-c68beaa4-15e6-42b8-b815-d99f1e5af44e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:52.986653 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-c68beaa4-15e6-42b8-b815-d99f1e5af44e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1278 microversion: 2.20 time: 0.138397 Aug 07 22:37:52.987369 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:37:52 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1278 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:37:53.087777 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-5809a78d-f14d-43f2-9c37-492b2fb2fec6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:53.088663 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-5809a78d-f14d-43f2-9c37-492b2fb2fec6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:53.103613 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5809a78d-f14d-43f2-9c37-492b2fb2fec6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:53.104641 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5809a78d-f14d-43f2-9c37-492b2fb2fec6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:53.106905 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5809a78d-f14d-43f2-9c37-492b2fb2fec6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:53.108914 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5809a78d-f14d-43f2-9c37-492b2fb2fec6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:53.109400 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5809a78d-f14d-43f2-9c37-492b2fb2fec6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:53.135328 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5809a78d-f14d-43f2-9c37-492b2fb2fec6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:53.315541 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-5809a78d-f14d-43f2-9c37-492b2fb2fec6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:53.327523 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-5809a78d-f14d-43f2-9c37-492b2fb2fec6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.245185 Aug 07 22:37:53.343052 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 34/66] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:53 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:53.625331 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-fb1192e9-42b1-4f45-8301-16efb85d8d51 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:53.625937 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-fb1192e9-42b1-4f45-8301-16efb85d8d51 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:53.633462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fb1192e9-42b1-4f45-8301-16efb85d8d51 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:53.633958 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fb1192e9-42b1-4f45-8301-16efb85d8d51 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:53.634397 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fb1192e9-42b1-4f45-8301-16efb85d8d51 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:53.635090 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fb1192e9-42b1-4f45-8301-16efb85d8d51 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:53.635533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fb1192e9-42b1-4f45-8301-16efb85d8d51 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:53.636052 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fb1192e9-42b1-4f45-8301-16efb85d8d51 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:53.818841 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-fb1192e9-42b1-4f45-8301-16efb85d8d51 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:53.830150 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-fb1192e9-42b1-4f45-8301-16efb85d8d51 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.208529 Aug 07 22:37:53.831705 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 33/67] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:53 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:54.011183 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-68d8de14-0cfb-4748-ad69-d38def9507e5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:54.012190 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-68d8de14-0cfb-4748-ad69-d38def9507e5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:54.020874 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-68d8de14-0cfb-4748-ad69-d38def9507e5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:54.028218 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-68d8de14-0cfb-4748-ad69-d38def9507e5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:54.028218 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-68d8de14-0cfb-4748-ad69-d38def9507e5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:54.028218 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-68d8de14-0cfb-4748-ad69-d38def9507e5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:54.028218 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-68d8de14-0cfb-4748-ad69-d38def9507e5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:54.028529 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-68d8de14-0cfb-4748-ad69-d38def9507e5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:54.216323 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-68d8de14-0cfb-4748-ad69-d38def9507e5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:54.231293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-68d8de14-0cfb-4748-ad69-d38def9507e5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:54.233017 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-68d8de14-0cfb-4748-ad69-d38def9507e5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:54.234196 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-68d8de14-0cfb-4748-ad69-d38def9507e5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1278 microversion: 2.20 time: 0.227303 Aug 07 22:37:54.246207 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:37:54 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1278 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:37:54.352398 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-c174b12e-b8de-4d34-8ae5-98f070e9892b tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:54.353297 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-c174b12e-b8de-4d34-8ae5-98f070e9892b tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:54.377982 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c174b12e-b8de-4d34-8ae5-98f070e9892b tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:54.386564 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c174b12e-b8de-4d34-8ae5-98f070e9892b tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:54.386564 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c174b12e-b8de-4d34-8ae5-98f070e9892b tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:54.388768 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c174b12e-b8de-4d34-8ae5-98f070e9892b tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:54.393488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c174b12e-b8de-4d34-8ae5-98f070e9892b tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:54.396393 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c174b12e-b8de-4d34-8ae5-98f070e9892b tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:54.478332 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=100 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:37:54.790148 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-c174b12e-b8de-4d34-8ae5-98f070e9892b tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:54.800182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-c174b12e-b8de-4d34-8ae5-98f070e9892b tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.453759 Aug 07 22:37:54.804122 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 34/69] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:54 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:54.856349 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-e66fd9b7-aea7-4f9d-9443-c491a79d960b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:54.857003 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-e66fd9b7-aea7-4f9d-9443-c491a79d960b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:54.865081 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e66fd9b7-aea7-4f9d-9443-c491a79d960b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:54.865852 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e66fd9b7-aea7-4f9d-9443-c491a79d960b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:54.866542 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e66fd9b7-aea7-4f9d-9443-c491a79d960b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:54.868712 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e66fd9b7-aea7-4f9d-9443-c491a79d960b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:54.869473 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e66fd9b7-aea7-4f9d-9443-c491a79d960b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:54.870158 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e66fd9b7-aea7-4f9d-9443-c491a79d960b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:55.180647 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-e66fd9b7-aea7-4f9d-9443-c491a79d960b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:55.180647 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-e66fd9b7-aea7-4f9d-9443-c491a79d960b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.326392 Aug 07 22:37:55.180647 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 36/70] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:54 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:55.268282 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b38fc05e-c2ce-4b15-8765-33553b78c593 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:55.268967 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-b38fc05e-c2ce-4b15-8765-33553b78c593 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:55.271529 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=6 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:37:55.272446 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=22 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:37:55.278295 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b38fc05e-c2ce-4b15-8765-33553b78c593 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:55.278782 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b38fc05e-c2ce-4b15-8765-33553b78c593 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:55.279218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b38fc05e-c2ce-4b15-8765-33553b78c593 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:55.279915 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b38fc05e-c2ce-4b15-8765-33553b78c593 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:55.280399 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b38fc05e-c2ce-4b15-8765-33553b78c593 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:55.280825 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b38fc05e-c2ce-4b15-8765-33553b78c593 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:55.368943 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-b38fc05e-c2ce-4b15-8765-33553b78c593 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:55.377194 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-b38fc05e-c2ce-4b15-8765-33553b78c593 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:55.378706 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-b38fc05e-c2ce-4b15-8765-33553b78c593 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:55.379814 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-b38fc05e-c2ce-4b15-8765-33553b78c593 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1334 microversion: 2.20 time: 0.115741 Aug 07 22:37:55.394283 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 35/71] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:37:55 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1334 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:37:55.821503 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-510c2a4d-f9ef-49c9-964c-59bedce5fc8f tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:55.827417 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-510c2a4d-f9ef-49c9-964c-59bedce5fc8f tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:55.828083 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-510c2a4d-f9ef-49c9-964c-59bedce5fc8f tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:55.828564 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-510c2a4d-f9ef-49c9-964c-59bedce5fc8f tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:55.828999 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-510c2a4d-f9ef-49c9-964c-59bedce5fc8f tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:55.829722 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-510c2a4d-f9ef-49c9-964c-59bedce5fc8f tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:55.830304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-510c2a4d-f9ef-49c9-964c-59bedce5fc8f tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:55.830731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-510c2a4d-f9ef-49c9-964c-59bedce5fc8f tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:55.973984 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-510c2a4d-f9ef-49c9-964c-59bedce5fc8f tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:55.984817 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-510c2a4d-f9ef-49c9-964c-59bedce5fc8f tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.167377 Aug 07 22:37:55.985531 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 37/72] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:55 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:56.208401 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-88dc79bb-1ea1-4474-9acf-ec8e81b5ba55 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:56.209019 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-88dc79bb-1ea1-4474-9acf-ec8e81b5ba55 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:56.217070 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-88dc79bb-1ea1-4474-9acf-ec8e81b5ba55 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:56.217554 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-88dc79bb-1ea1-4474-9acf-ec8e81b5ba55 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:56.217995 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-88dc79bb-1ea1-4474-9acf-ec8e81b5ba55 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:56.218683 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-88dc79bb-1ea1-4474-9acf-ec8e81b5ba55 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:56.219138 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-88dc79bb-1ea1-4474-9acf-ec8e81b5ba55 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:56.219557 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-88dc79bb-1ea1-4474-9acf-ec8e81b5ba55 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:56.357039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-88dc79bb-1ea1-4474-9acf-ec8e81b5ba55 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:56.364399 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-88dc79bb-1ea1-4474-9acf-ec8e81b5ba55 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.159795 Aug 07 22:37:56.364964 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 36/73] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:56 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:56.404189 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-df7c3549-640a-4622-9f84-f36cd4d52cec tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:56.404795 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-df7c3549-640a-4622-9f84-f36cd4d52cec tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:56.406725 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=2 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:37:56.411533 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-df7c3549-640a-4622-9f84-f36cd4d52cec tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:56.412027 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-df7c3549-640a-4622-9f84-f36cd4d52cec tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:56.412475 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-df7c3549-640a-4622-9f84-f36cd4d52cec tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:56.413160 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-df7c3549-640a-4622-9f84-f36cd4d52cec tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:56.414205 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-df7c3549-640a-4622-9f84-f36cd4d52cec tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:56.414751 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-df7c3549-640a-4622-9f84-f36cd4d52cec tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:56.474985 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-df7c3549-640a-4622-9f84-f36cd4d52cec tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:56.478892 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=100 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:37:56.483760 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-df7c3549-640a-4622-9f84-f36cd4d52cec tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:56.485299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-df7c3549-640a-4622-9f84-f36cd4d52cec tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:56.486384 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-df7c3549-640a-4622-9f84-f36cd4d52cec tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1334 microversion: 2.20 time: 0.086233 Aug 07 22:37:56.486939 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 38/74] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:37:56 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1334 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:37:57.005773 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-13f26b85-4f64-43e4-af95-88d73a875f8c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:57.006380 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-13f26b85-4f64-43e4-af95-88d73a875f8c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:57.010055 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:37:57.013356 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-13f26b85-4f64-43e4-af95-88d73a875f8c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:57.013828 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-13f26b85-4f64-43e4-af95-88d73a875f8c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:57.014257 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-13f26b85-4f64-43e4-af95-88d73a875f8c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:57.014932 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-13f26b85-4f64-43e4-af95-88d73a875f8c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:57.015380 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-13f26b85-4f64-43e4-af95-88d73a875f8c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:57.015795 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-13f26b85-4f64-43e4-af95-88d73a875f8c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:57.145531 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-13f26b85-4f64-43e4-af95-88d73a875f8c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:57.153196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-13f26b85-4f64-43e4-af95-88d73a875f8c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.151340 Aug 07 22:37:57.153767 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 37/75] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:57 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:57.386395 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-6b0523b5-f2bd-4991-8256-de80fddbab90 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:57.387008 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-6b0523b5-f2bd-4991-8256-de80fddbab90 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:57.389158 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=20 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:37:57.394062 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6b0523b5-f2bd-4991-8256-de80fddbab90 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:57.394539 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6b0523b5-f2bd-4991-8256-de80fddbab90 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:57.394969 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6b0523b5-f2bd-4991-8256-de80fddbab90 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:57.395651 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6b0523b5-f2bd-4991-8256-de80fddbab90 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:57.396130 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6b0523b5-f2bd-4991-8256-de80fddbab90 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:57.400704 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6b0523b5-f2bd-4991-8256-de80fddbab90 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:57.509567 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-05b6b156-4170-4092-a85f-3a6b2b928fc7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:57.510264 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-05b6b156-4170-4092-a85f-3a6b2b928fc7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:57.516188 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-05b6b156-4170-4092-a85f-3a6b2b928fc7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:57.516740 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-05b6b156-4170-4092-a85f-3a6b2b928fc7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:57.517178 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-05b6b156-4170-4092-a85f-3a6b2b928fc7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:57.517961 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-05b6b156-4170-4092-a85f-3a6b2b928fc7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:57.518479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-05b6b156-4170-4092-a85f-3a6b2b928fc7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:57.518995 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-05b6b156-4170-4092-a85f-3a6b2b928fc7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:57.527236 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-6b0523b5-f2bd-4991-8256-de80fddbab90 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:57.534718 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-6b0523b5-f2bd-4991-8256-de80fddbab90 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.153041 Aug 07 22:37:57.535292 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 39/76] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:57 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:57.579718 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-05b6b156-4170-4092-a85f-3a6b2b928fc7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:57.587717 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-05b6b156-4170-4092-a85f-3a6b2b928fc7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:57.589235 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-05b6b156-4170-4092-a85f-3a6b2b928fc7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:57.590336 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-05b6b156-4170-4092-a85f-3a6b2b928fc7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1334 microversion: 2.20 time: 0.085555 Aug 07 22:37:57.590910 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 38/77] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:37:57 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1334 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:37:58.174099 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-049dfe18-80d1-45e1-a425-7cd5a57b6c5c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:58.174713 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-049dfe18-80d1-45e1-a425-7cd5a57b6c5c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:58.180942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-049dfe18-80d1-45e1-a425-7cd5a57b6c5c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:58.181422 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-049dfe18-80d1-45e1-a425-7cd5a57b6c5c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:58.181862 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-049dfe18-80d1-45e1-a425-7cd5a57b6c5c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:58.182549 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-049dfe18-80d1-45e1-a425-7cd5a57b6c5c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:58.183001 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-049dfe18-80d1-45e1-a425-7cd5a57b6c5c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:58.183430 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-049dfe18-80d1-45e1-a425-7cd5a57b6c5c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:58.321553 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-049dfe18-80d1-45e1-a425-7cd5a57b6c5c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:58.329211 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-049dfe18-80d1-45e1-a425-7cd5a57b6c5c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.159025 Aug 07 22:37:58.329807 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 40/78] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:58 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:58.554705 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-8282bbd6-d991-4335-900a-ecb0d9a88de4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:58.555305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-8282bbd6-d991-4335-900a-ecb0d9a88de4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:58.561294 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8282bbd6-d991-4335-900a-ecb0d9a88de4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:58.561765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8282bbd6-d991-4335-900a-ecb0d9a88de4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:58.564300 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8282bbd6-d991-4335-900a-ecb0d9a88de4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:58.564300 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8282bbd6-d991-4335-900a-ecb0d9a88de4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:58.564300 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8282bbd6-d991-4335-900a-ecb0d9a88de4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:58.564300 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8282bbd6-d991-4335-900a-ecb0d9a88de4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:58.613556 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-cd8aca9c-8bac-4625-aa92-913a56d2595c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:58.614805 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-cd8aca9c-8bac-4625-aa92-913a56d2595c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:58.621348 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cd8aca9c-8bac-4625-aa92-913a56d2595c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:58.621997 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cd8aca9c-8bac-4625-aa92-913a56d2595c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:58.622432 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cd8aca9c-8bac-4625-aa92-913a56d2595c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:58.623145 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cd8aca9c-8bac-4625-aa92-913a56d2595c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:58.623592 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cd8aca9c-8bac-4625-aa92-913a56d2595c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:58.624117 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cd8aca9c-8bac-4625-aa92-913a56d2595c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:58.705805 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-cd8aca9c-8bac-4625-aa92-913a56d2595c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:58.714471 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-cd8aca9c-8bac-4625-aa92-913a56d2595c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:58.716228 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-cd8aca9c-8bac-4625-aa92-913a56d2595c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:58.717262 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-cd8aca9c-8bac-4625-aa92-913a56d2595c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1342 microversion: 2.20 time: 0.108058 Aug 07 22:37:58.717841 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 41/79] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:37:58 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1342 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:37:58.731058 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-8282bbd6-d991-4335-900a-ecb0d9a88de4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:58.739332 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-8282bbd6-d991-4335-900a-ecb0d9a88de4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.188409 Aug 07 22:37:58.748356 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 39/80] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:58 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:59.350708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-2d8d256f-3c8f-49d9-b645-fb04bd2b0855 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:59.352226 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-2d8d256f-3c8f-49d9-b645-fb04bd2b0855 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:59.358143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2d8d256f-3c8f-49d9-b645-fb04bd2b0855 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:59.358619 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2d8d256f-3c8f-49d9-b645-fb04bd2b0855 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:59.359050 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2d8d256f-3c8f-49d9-b645-fb04bd2b0855 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:59.359734 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2d8d256f-3c8f-49d9-b645-fb04bd2b0855 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:59.360213 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2d8d256f-3c8f-49d9-b645-fb04bd2b0855 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:59.360633 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2d8d256f-3c8f-49d9-b645-fb04bd2b0855 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:59.658925 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-2d8d256f-3c8f-49d9-b645-fb04bd2b0855 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:59.681160 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-2d8d256f-3c8f-49d9-b645-fb04bd2b0855 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.320244 Aug 07 22:37:59.681160 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 42/81] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:59 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:37:59.740699 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-dd6e52c9-fe7b-4b48-91bc-949c27c9ed59 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:59.741380 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-dd6e52c9-fe7b-4b48-91bc-949c27c9ed59 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:59.747285 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dd6e52c9-fe7b-4b48-91bc-949c27c9ed59 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:59.747758 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dd6e52c9-fe7b-4b48-91bc-949c27c9ed59 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:59.748226 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dd6e52c9-fe7b-4b48-91bc-949c27c9ed59 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:59.748919 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dd6e52c9-fe7b-4b48-91bc-949c27c9ed59 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:59.749365 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dd6e52c9-fe7b-4b48-91bc-949c27c9ed59 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:59.749802 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dd6e52c9-fe7b-4b48-91bc-949c27c9ed59 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:59.766476 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-9734e1aa-9d89-4ed9-b0bc-7759b428508b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:37:59.767090 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-9734e1aa-9d89-4ed9-b0bc-7759b428508b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:37:59.773476 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9734e1aa-9d89-4ed9-b0bc-7759b428508b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:59.773960 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9734e1aa-9d89-4ed9-b0bc-7759b428508b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:59.774490 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9734e1aa-9d89-4ed9-b0bc-7759b428508b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:59.775236 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9734e1aa-9d89-4ed9-b0bc-7759b428508b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:37:59.775718 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9734e1aa-9d89-4ed9-b0bc-7759b428508b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:37:59.776173 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9734e1aa-9d89-4ed9-b0bc-7759b428508b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:37:59.825313 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-dd6e52c9-fe7b-4b48-91bc-949c27c9ed59 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:59.833829 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-dd6e52c9-fe7b-4b48-91bc-949c27c9ed59 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:59.835435 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-dd6e52c9-fe7b-4b48-91bc-949c27c9ed59 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:59.837264 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-dd6e52c9-fe7b-4b48-91bc-949c27c9ed59 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1342 microversion: 2.20 time: 0.100413 Aug 07 22:37:59.837828 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 40/82] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:37:59 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1342 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:37:59.918673 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-9734e1aa-9d89-4ed9-b0bc-7759b428508b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:37:59.926278 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-9734e1aa-9d89-4ed9-b0bc-7759b428508b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.163597 Aug 07 22:37:59.926848 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 43/83] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:37:59 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:38:00.690577 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-05a1a251-bfda-4e04-b88c-93381fa1ff2e tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:00.691216 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-05a1a251-bfda-4e04-b88c-93381fa1ff2e tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:00.697094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-05a1a251-bfda-4e04-b88c-93381fa1ff2e tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:00.697569 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-05a1a251-bfda-4e04-b88c-93381fa1ff2e tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:00.697999 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-05a1a251-bfda-4e04-b88c-93381fa1ff2e tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:00.698672 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-05a1a251-bfda-4e04-b88c-93381fa1ff2e tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:00.699114 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-05a1a251-bfda-4e04-b88c-93381fa1ff2e tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:00.699560 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-05a1a251-bfda-4e04-b88c-93381fa1ff2e tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:00.826379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-05a1a251-bfda-4e04-b88c-93381fa1ff2e tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:00.833709 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-05a1a251-bfda-4e04-b88c-93381fa1ff2e tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.146959 Aug 07 22:38:00.834266 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 41/84] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:00 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:00.859903 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-8b3ba4ae-f952-47b8-be94-454b79c7a3d5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:00.860557 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-8b3ba4ae-f952-47b8-be94-454b79c7a3d5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:00.866471 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8b3ba4ae-f952-47b8-be94-454b79c7a3d5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:00.867571 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8b3ba4ae-f952-47b8-be94-454b79c7a3d5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:00.868129 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8b3ba4ae-f952-47b8-be94-454b79c7a3d5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:00.868811 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8b3ba4ae-f952-47b8-be94-454b79c7a3d5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:00.869257 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8b3ba4ae-f952-47b8-be94-454b79c7a3d5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:00.869826 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8b3ba4ae-f952-47b8-be94-454b79c7a3d5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:00.937915 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8b3ba4ae-f952-47b8-be94-454b79c7a3d5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:00.947092 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-69eee708-85e5-4536-aba6-1eb642df130a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:00.947540 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8b3ba4ae-f952-47b8-be94-454b79c7a3d5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:00.947719 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-69eee708-85e5-4536-aba6-1eb642df130a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:00.949348 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8b3ba4ae-f952-47b8-be94-454b79c7a3d5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:00.950516 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-8b3ba4ae-f952-47b8-be94-454b79c7a3d5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1342 microversion: 2.20 time: 0.094673 Aug 07 22:38:00.951071 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 44/85] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:38:00 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1342 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:38:00.953582 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-69eee708-85e5-4536-aba6-1eb642df130a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:00.954056 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-69eee708-85e5-4536-aba6-1eb642df130a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:00.954479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-69eee708-85e5-4536-aba6-1eb642df130a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:00.955184 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-69eee708-85e5-4536-aba6-1eb642df130a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:00.955625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-69eee708-85e5-4536-aba6-1eb642df130a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:00.956057 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-69eee708-85e5-4536-aba6-1eb642df130a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:01.090618 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-69eee708-85e5-4536-aba6-1eb642df130a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:01.097919 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-69eee708-85e5-4536-aba6-1eb642df130a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.154667 Aug 07 22:38:01.098550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 42/86] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:00 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:01.854636 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-957ede4f-9564-4f96-9cea-036d84629cd5 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:01.855246 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-957ede4f-9564-4f96-9cea-036d84629cd5 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:01.857147 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:38:01.862118 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-957ede4f-9564-4f96-9cea-036d84629cd5 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:01.862695 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-957ede4f-9564-4f96-9cea-036d84629cd5 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:01.863635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-957ede4f-9564-4f96-9cea-036d84629cd5 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:01.864504 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-957ede4f-9564-4f96-9cea-036d84629cd5 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:01.864962 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-957ede4f-9564-4f96-9cea-036d84629cd5 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:01.865403 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-957ede4f-9564-4f96-9cea-036d84629cd5 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:01.974722 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-530d8faf-3ba9-405d-85e1-8eb64711e6d3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:01.975606 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-530d8faf-3ba9-405d-85e1-8eb64711e6d3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:01.982340 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-530d8faf-3ba9-405d-85e1-8eb64711e6d3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:01.982899 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-530d8faf-3ba9-405d-85e1-8eb64711e6d3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:01.983400 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-530d8faf-3ba9-405d-85e1-8eb64711e6d3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:01.984192 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-530d8faf-3ba9-405d-85e1-8eb64711e6d3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:01.984714 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-530d8faf-3ba9-405d-85e1-8eb64711e6d3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:01.985213 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-530d8faf-3ba9-405d-85e1-8eb64711e6d3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:02.000083 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-957ede4f-9564-4f96-9cea-036d84629cd5 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:02.007851 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-957ede4f-9564-4f96-9cea-036d84629cd5 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.157118 Aug 07 22:38:02.008636 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 45/87] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:01 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:02.047377 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-530d8faf-3ba9-405d-85e1-8eb64711e6d3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:02.061151 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-530d8faf-3ba9-405d-85e1-8eb64711e6d3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:02.061151 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-530d8faf-3ba9-405d-85e1-8eb64711e6d3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:02.061151 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-530d8faf-3ba9-405d-85e1-8eb64711e6d3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1342 microversion: 2.20 time: 0.088183 Aug 07 22:38:02.061479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 43/88] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:38:01 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1342 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:38:02.119945 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-80e6c1e7-2e22-45f4-8db6-97805dabc359 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:02.120575 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-80e6c1e7-2e22-45f4-8db6-97805dabc359 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:02.126553 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-80e6c1e7-2e22-45f4-8db6-97805dabc359 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:02.127025 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-80e6c1e7-2e22-45f4-8db6-97805dabc359 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:02.127453 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-80e6c1e7-2e22-45f4-8db6-97805dabc359 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:02.128156 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-80e6c1e7-2e22-45f4-8db6-97805dabc359 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:02.128601 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-80e6c1e7-2e22-45f4-8db6-97805dabc359 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:02.129018 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-80e6c1e7-2e22-45f4-8db6-97805dabc359 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:02.262210 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-80e6c1e7-2e22-45f4-8db6-97805dabc359 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:02.271492 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-80e6c1e7-2e22-45f4-8db6-97805dabc359 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.156009 Aug 07 22:38:02.272249 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 46/89] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:02 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:03.028986 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-2821bc09-fc38-4ad7-85de-a77c64e0d3be tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:03.029676 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-2821bc09-fc38-4ad7-85de-a77c64e0d3be tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:03.035638 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2821bc09-fc38-4ad7-85de-a77c64e0d3be tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:03.036159 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2821bc09-fc38-4ad7-85de-a77c64e0d3be tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:03.036652 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2821bc09-fc38-4ad7-85de-a77c64e0d3be tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:03.037318 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2821bc09-fc38-4ad7-85de-a77c64e0d3be tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:03.037767 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2821bc09-fc38-4ad7-85de-a77c64e0d3be tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:03.038194 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2821bc09-fc38-4ad7-85de-a77c64e0d3be tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:03.081269 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-fd6eb744-92e2-4ae3-98b2-16bbc561f086 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:03.081786 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-fd6eb744-92e2-4ae3-98b2-16bbc561f086 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:03.088909 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fd6eb744-92e2-4ae3-98b2-16bbc561f086 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:03.095215 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fd6eb744-92e2-4ae3-98b2-16bbc561f086 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:03.095215 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fd6eb744-92e2-4ae3-98b2-16bbc561f086 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:03.095215 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fd6eb744-92e2-4ae3-98b2-16bbc561f086 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:03.095215 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fd6eb744-92e2-4ae3-98b2-16bbc561f086 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:03.095719 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fd6eb744-92e2-4ae3-98b2-16bbc561f086 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:03.172375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-fd6eb744-92e2-4ae3-98b2-16bbc561f086 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:03.181653 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-fd6eb744-92e2-4ae3-98b2-16bbc561f086 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:03.183318 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-fd6eb744-92e2-4ae3-98b2-16bbc561f086 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:03.184592 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-fd6eb744-92e2-4ae3-98b2-16bbc561f086 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1342 microversion: 2.20 time: 0.107545 Aug 07 22:38:03.185383 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 47/90] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:38:03 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1342 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:38:03.209183 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-2821bc09-fc38-4ad7-85de-a77c64e0d3be tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:03.214789 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-2821bc09-fc38-4ad7-85de-a77c64e0d3be tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.189680 Aug 07 22:38:03.215361 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 44/91] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:03 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:03.293233 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-10b273ad-a3a9-4342-a9b0-7112e02daadf tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:03.293843 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-10b273ad-a3a9-4342-a9b0-7112e02daadf tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:03.299594 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-10b273ad-a3a9-4342-a9b0-7112e02daadf tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:03.300090 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-10b273ad-a3a9-4342-a9b0-7112e02daadf tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:03.300526 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-10b273ad-a3a9-4342-a9b0-7112e02daadf tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:03.301260 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-10b273ad-a3a9-4342-a9b0-7112e02daadf tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:03.301704 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-10b273ad-a3a9-4342-a9b0-7112e02daadf tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:03.302129 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-10b273ad-a3a9-4342-a9b0-7112e02daadf tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:03.436159 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-10b273ad-a3a9-4342-a9b0-7112e02daadf tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:03.443467 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-10b273ad-a3a9-4342-a9b0-7112e02daadf tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.154951 Aug 07 22:38:03.444031 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 48/92] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:03 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:04.206886 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-22f68384-70a9-44d0-8c58-5d8508b914f7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:04.207464 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-22f68384-70a9-44d0-8c58-5d8508b914f7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:04.214179 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-22f68384-70a9-44d0-8c58-5d8508b914f7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:04.214654 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-22f68384-70a9-44d0-8c58-5d8508b914f7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:04.215084 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-22f68384-70a9-44d0-8c58-5d8508b914f7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:04.215770 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-22f68384-70a9-44d0-8c58-5d8508b914f7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:04.216262 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-22f68384-70a9-44d0-8c58-5d8508b914f7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:04.216671 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-22f68384-70a9-44d0-8c58-5d8508b914f7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:04.236597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-c936733a-346e-462a-96be-d28bedaa2e8c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:04.237204 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-c936733a-346e-462a-96be-d28bedaa2e8c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:04.243216 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c936733a-346e-462a-96be-d28bedaa2e8c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:04.243694 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c936733a-346e-462a-96be-d28bedaa2e8c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:04.244149 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c936733a-346e-462a-96be-d28bedaa2e8c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:04.244834 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c936733a-346e-462a-96be-d28bedaa2e8c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:04.245281 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c936733a-346e-462a-96be-d28bedaa2e8c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:04.245698 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c936733a-346e-462a-96be-d28bedaa2e8c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:04.279246 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-22f68384-70a9-44d0-8c58-5d8508b914f7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:04.287265 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-22f68384-70a9-44d0-8c58-5d8508b914f7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:04.288823 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-22f68384-70a9-44d0-8c58-5d8508b914f7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:04.290000 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-22f68384-70a9-44d0-8c58-5d8508b914f7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1342 microversion: 2.20 time: 0.087196 Aug 07 22:38:04.290715 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 45/93] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:38:04 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1342 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:38:04.378335 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-c936733a-346e-462a-96be-d28bedaa2e8c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:04.386307 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-c936733a-346e-462a-96be-d28bedaa2e8c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.153843 Aug 07 22:38:04.386869 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 49/94] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:04 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:38:04.464059 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-28edddd4-378d-4239-bba5-3ede4cf33809 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:04.464628 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-28edddd4-378d-4239-bba5-3ede4cf33809 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:04.470428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-28edddd4-378d-4239-bba5-3ede4cf33809 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:04.470904 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-28edddd4-378d-4239-bba5-3ede4cf33809 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:04.471336 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-28edddd4-378d-4239-bba5-3ede4cf33809 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:04.472028 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-28edddd4-378d-4239-bba5-3ede4cf33809 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:04.472481 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-28edddd4-378d-4239-bba5-3ede4cf33809 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:04.472900 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-28edddd4-378d-4239-bba5-3ede4cf33809 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:04.605128 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-28edddd4-378d-4239-bba5-3ede4cf33809 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:04.612723 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-28edddd4-378d-4239-bba5-3ede4cf33809 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.152512 Aug 07 22:38:04.613272 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 46/95] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:04 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:05.313380 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-5d236d4b-19ab-42e5-b59a-4f13aaeb5564 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:05.313988 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-5d236d4b-19ab-42e5-b59a-4f13aaeb5564 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:05.319927 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5d236d4b-19ab-42e5-b59a-4f13aaeb5564 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:05.320437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5d236d4b-19ab-42e5-b59a-4f13aaeb5564 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:05.321412 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5d236d4b-19ab-42e5-b59a-4f13aaeb5564 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:05.322173 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5d236d4b-19ab-42e5-b59a-4f13aaeb5564 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:05.322626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5d236d4b-19ab-42e5-b59a-4f13aaeb5564 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:05.323096 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5d236d4b-19ab-42e5-b59a-4f13aaeb5564 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:05.390516 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-5d236d4b-19ab-42e5-b59a-4f13aaeb5564 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:05.399772 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-5d236d4b-19ab-42e5-b59a-4f13aaeb5564 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:05.403334 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-5d236d4b-19ab-42e5-b59a-4f13aaeb5564 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:05.404515 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-5d236d4b-19ab-42e5-b59a-4f13aaeb5564 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1342 microversion: 2.20 time: 0.095261 Aug 07 22:38:05.405065 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 50/96] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:38:05 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1342 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:38:05.408986 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-decc2ef0-353f-4409-9e67-dbf4122fa7d2 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:05.410398 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-decc2ef0-353f-4409-9e67-dbf4122fa7d2 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:05.417978 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-decc2ef0-353f-4409-9e67-dbf4122fa7d2 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:05.418524 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-decc2ef0-353f-4409-9e67-dbf4122fa7d2 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:05.419224 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-decc2ef0-353f-4409-9e67-dbf4122fa7d2 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:05.419868 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-decc2ef0-353f-4409-9e67-dbf4122fa7d2 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:05.420406 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-decc2ef0-353f-4409-9e67-dbf4122fa7d2 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:05.420951 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-decc2ef0-353f-4409-9e67-dbf4122fa7d2 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:05.581205 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-decc2ef0-353f-4409-9e67-dbf4122fa7d2 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:05.588779 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-decc2ef0-353f-4409-9e67-dbf4122fa7d2 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.185788 Aug 07 22:38:05.589401 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 47/97] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:05 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:05.633998 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-09b5e047-f045-487d-aa17-0834be98eae1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:05.634714 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-09b5e047-f045-487d-aa17-0834be98eae1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:05.640760 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-09b5e047-f045-487d-aa17-0834be98eae1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:05.641256 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-09b5e047-f045-487d-aa17-0834be98eae1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:05.641694 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-09b5e047-f045-487d-aa17-0834be98eae1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:05.642419 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-09b5e047-f045-487d-aa17-0834be98eae1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:05.642871 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-09b5e047-f045-487d-aa17-0834be98eae1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:05.643296 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-09b5e047-f045-487d-aa17-0834be98eae1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:05.785362 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-09b5e047-f045-487d-aa17-0834be98eae1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:05.794194 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-09b5e047-f045-487d-aa17-0834be98eae1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.164941 Aug 07 22:38:05.794807 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 51/98] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:05 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:06.428331 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-1f2bf57a-dbf3-47ab-b210-f3ba1a3e53dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:06.429179 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-1f2bf57a-dbf3-47ab-b210-f3ba1a3e53dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:06.437526 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1f2bf57a-dbf3-47ab-b210-f3ba1a3e53dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:06.443482 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1f2bf57a-dbf3-47ab-b210-f3ba1a3e53dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:06.443482 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1f2bf57a-dbf3-47ab-b210-f3ba1a3e53dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:06.443482 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1f2bf57a-dbf3-47ab-b210-f3ba1a3e53dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:06.443482 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1f2bf57a-dbf3-47ab-b210-f3ba1a3e53dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:06.443880 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1f2bf57a-dbf3-47ab-b210-f3ba1a3e53dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:06.503640 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-1f2bf57a-dbf3-47ab-b210-f3ba1a3e53dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:06.513473 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-1f2bf57a-dbf3-47ab-b210-f3ba1a3e53dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:06.515081 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-1f2bf57a-dbf3-47ab-b210-f3ba1a3e53dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:06.516356 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-1f2bf57a-dbf3-47ab-b210-f3ba1a3e53dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1352 microversion: 2.20 time: 0.093489 Aug 07 22:38:06.516982 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 48/99] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:38:06 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:38:06.609948 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-3005eb79-1d8b-4826-b8f6-e8193f86f946 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:06.610575 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-3005eb79-1d8b-4826-b8f6-e8193f86f946 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:06.616882 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3005eb79-1d8b-4826-b8f6-e8193f86f946 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:06.617355 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3005eb79-1d8b-4826-b8f6-e8193f86f946 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:06.618434 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3005eb79-1d8b-4826-b8f6-e8193f86f946 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:06.619124 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3005eb79-1d8b-4826-b8f6-e8193f86f946 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:06.619572 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3005eb79-1d8b-4826-b8f6-e8193f86f946 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:06.619987 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3005eb79-1d8b-4826-b8f6-e8193f86f946 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:06.754455 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-3005eb79-1d8b-4826-b8f6-e8193f86f946 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:06.763438 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-3005eb79-1d8b-4826-b8f6-e8193f86f946 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.157338 Aug 07 22:38:06.764596 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 52/100] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:06 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:38:06.816420 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-314c6621-01f7-475f-9785-f3650b52eee9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:06.817262 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-314c6621-01f7-475f-9785-f3650b52eee9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:06.842709 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-314c6621-01f7-475f-9785-f3650b52eee9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:06.843346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-314c6621-01f7-475f-9785-f3650b52eee9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:06.844003 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-314c6621-01f7-475f-9785-f3650b52eee9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:06.844780 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-314c6621-01f7-475f-9785-f3650b52eee9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:06.845384 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-314c6621-01f7-475f-9785-f3650b52eee9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:06.846014 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-314c6621-01f7-475f-9785-f3650b52eee9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:07.263935 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-314c6621-01f7-475f-9785-f3650b52eee9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:07.271839 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-314c6621-01f7-475f-9785-f3650b52eee9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.459157 Aug 07 22:38:07.272704 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 49/101] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:06 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:07.543985 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-76de086f-b7d8-4538-8956-1998cb7b2027 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:07.544747 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-76de086f-b7d8-4538-8956-1998cb7b2027 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:07.551073 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-76de086f-b7d8-4538-8956-1998cb7b2027 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:07.556189 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-76de086f-b7d8-4538-8956-1998cb7b2027 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:07.556189 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-76de086f-b7d8-4538-8956-1998cb7b2027 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:07.556189 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-76de086f-b7d8-4538-8956-1998cb7b2027 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:07.556787 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-76de086f-b7d8-4538-8956-1998cb7b2027 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:07.557959 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-76de086f-b7d8-4538-8956-1998cb7b2027 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:07.785579 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-5bdf0154-c261-4f9c-ae57-16f7a3c5532e tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:07.786189 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-5bdf0154-c261-4f9c-ae57-16f7a3c5532e tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:07.793021 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5bdf0154-c261-4f9c-ae57-16f7a3c5532e tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:07.793860 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5bdf0154-c261-4f9c-ae57-16f7a3c5532e tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:07.794697 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5bdf0154-c261-4f9c-ae57-16f7a3c5532e tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:07.795619 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5bdf0154-c261-4f9c-ae57-16f7a3c5532e tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:07.796164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5bdf0154-c261-4f9c-ae57-16f7a3c5532e tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:07.796796 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5bdf0154-c261-4f9c-ae57-16f7a3c5532e tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:07.886024 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-76de086f-b7d8-4538-8956-1998cb7b2027 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:07.894773 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-76de086f-b7d8-4538-8956-1998cb7b2027 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:07.899680 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-76de086f-b7d8-4538-8956-1998cb7b2027 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:07.899680 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-76de086f-b7d8-4538-8956-1998cb7b2027 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1340 microversion: 2.20 time: 0.358499 Aug 07 22:38:07.899680 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 53/102] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:38:07 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1340 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:38:08.186886 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-5bdf0154-c261-4f9c-ae57-16f7a3c5532e tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:08.198433 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-5bdf0154-c261-4f9c-ae57-16f7a3c5532e tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.414604 Aug 07 22:38:08.198963 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 50/103] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:07 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:08.299839 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-a8ec17ef-8f75-4876-9702-47cc392314ca tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:08.300487 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-a8ec17ef-8f75-4876-9702-47cc392314ca tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:08.314267 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a8ec17ef-8f75-4876-9702-47cc392314ca tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:08.315360 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a8ec17ef-8f75-4876-9702-47cc392314ca tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:08.315906 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a8ec17ef-8f75-4876-9702-47cc392314ca tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:08.317827 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a8ec17ef-8f75-4876-9702-47cc392314ca tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:08.318344 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a8ec17ef-8f75-4876-9702-47cc392314ca tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:08.318975 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a8ec17ef-8f75-4876-9702-47cc392314ca tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:08.519796 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-a8ec17ef-8f75-4876-9702-47cc392314ca tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:08.529731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-a8ec17ef-8f75-4876-9702-47cc392314ca tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.237411 Aug 07 22:38:08.530331 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 54/104] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:08 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:08.923653 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-38285e9e-1b64-4b2d-b45e-3171baad21c0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:08.924414 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-38285e9e-1b64-4b2d-b45e-3171baad21c0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:08.937041 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-38285e9e-1b64-4b2d-b45e-3171baad21c0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:08.939593 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-38285e9e-1b64-4b2d-b45e-3171baad21c0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:08.941026 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-38285e9e-1b64-4b2d-b45e-3171baad21c0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:08.943278 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-38285e9e-1b64-4b2d-b45e-3171baad21c0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:08.947257 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-38285e9e-1b64-4b2d-b45e-3171baad21c0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:08.947925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-38285e9e-1b64-4b2d-b45e-3171baad21c0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:08.962403 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=100 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:38:09.209491 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-38285e9e-1b64-4b2d-b45e-3171baad21c0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:09.220174 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-38285e9e-1b64-4b2d-b45e-3171baad21c0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:09.222078 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-38285e9e-1b64-4b2d-b45e-3171baad21c0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:09.223327 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-38285e9e-1b64-4b2d-b45e-3171baad21c0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1407 microversion: 2.20 time: 0.306174 Aug 07 22:38:09.223615 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d64ad43e-81ed-4888-82fe-53fecf2fbd82 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:09.224595 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 51/105] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:38:08 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1407 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:38:09.228959 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-d64ad43e-81ed-4888-82fe-53fecf2fbd82 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:09.239403 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d64ad43e-81ed-4888-82fe-53fecf2fbd82 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:09.240137 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d64ad43e-81ed-4888-82fe-53fecf2fbd82 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:09.243427 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d64ad43e-81ed-4888-82fe-53fecf2fbd82 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:09.245281 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d64ad43e-81ed-4888-82fe-53fecf2fbd82 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:09.245281 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d64ad43e-81ed-4888-82fe-53fecf2fbd82 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:09.245281 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d64ad43e-81ed-4888-82fe-53fecf2fbd82 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:09.265448 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=100 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:38:09.418664 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-d64ad43e-81ed-4888-82fe-53fecf2fbd82 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:09.426811 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-d64ad43e-81ed-4888-82fe-53fecf2fbd82 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.210381 Aug 07 22:38:09.427540 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 55/106] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:09 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:38:09.552856 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-141f3532-a06b-43d9-a1ff-5da5839ad4f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:09.556054 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-141f3532-a06b-43d9-a1ff-5da5839ad4f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:09.564610 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-141f3532-a06b-43d9-a1ff-5da5839ad4f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:09.565452 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-141f3532-a06b-43d9-a1ff-5da5839ad4f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:09.566055 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-141f3532-a06b-43d9-a1ff-5da5839ad4f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:09.567735 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-141f3532-a06b-43d9-a1ff-5da5839ad4f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:09.568523 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-141f3532-a06b-43d9-a1ff-5da5839ad4f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:09.569599 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-141f3532-a06b-43d9-a1ff-5da5839ad4f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:09.804460 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-141f3532-a06b-43d9-a1ff-5da5839ad4f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:09.812993 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-141f3532-a06b-43d9-a1ff-5da5839ad4f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.264755 Aug 07 22:38:09.813561 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 52/107] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:09 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:09.998102 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-f72ee47d-3a4a-47c5-a3bd-5de95402c49e req-568da850-0f26-4341-b1f9-277123113528 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bda9470-bb0f-45e2-9f1b-e4d1db51aeba", "tag": "1f737453-339e-4e1d-8c0b-b401edea34b1"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:38:10.038263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-f72ee47d-3a4a-47c5-a3bd-5de95402c49e req-568da850-0f26-4341-b1f9-277123113528 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:10.038762 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-f72ee47d-3a4a-47c5-a3bd-5de95402c49e req-568da850-0f26-4341-b1f9-277123113528 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:10.039836 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-f72ee47d-3a4a-47c5-a3bd-5de95402c49e req-568da850-0f26-4341-b1f9-277123113528 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:10.059787 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-f72ee47d-3a4a-47c5-a3bd-5de95402c49e req-568da850-0f26-4341-b1f9-277123113528 service nova] Creating event network-changed:1f737453-339e-4e1d-8c0b-b401edea34b1 for instance 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba on hv-cinder-85032 Aug 07 22:38:10.071412 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-f72ee47d-3a4a-47c5-a3bd-5de95402c49e req-568da850-0f26-4341-b1f9-277123113528 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078027 Aug 07 22:38:10.073117 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 56/108] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:38:10.247522 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-29077f15-673f-4592-a69f-645759acec30 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:10.248350 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-29077f15-673f-4592-a69f-645759acec30 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:10.261674 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-29077f15-673f-4592-a69f-645759acec30 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:10.262152 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-29077f15-673f-4592-a69f-645759acec30 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:10.262609 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-29077f15-673f-4592-a69f-645759acec30 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:10.273025 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-29077f15-673f-4592-a69f-645759acec30 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:10.273542 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-29077f15-673f-4592-a69f-645759acec30 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:10.274037 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-29077f15-673f-4592-a69f-645759acec30 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:10.453168 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-e6e9b699-8dba-457c-b491-46d57ddeb0d8 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:10.456543 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-e6e9b699-8dba-457c-b491-46d57ddeb0d8 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:10.465759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e6e9b699-8dba-457c-b491-46d57ddeb0d8 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:10.468103 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e6e9b699-8dba-457c-b491-46d57ddeb0d8 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:10.468620 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e6e9b699-8dba-457c-b491-46d57ddeb0d8 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:10.469514 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e6e9b699-8dba-457c-b491-46d57ddeb0d8 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:10.472319 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e6e9b699-8dba-457c-b491-46d57ddeb0d8 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:10.473926 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e6e9b699-8dba-457c-b491-46d57ddeb0d8 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:10.848176 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-29077f15-673f-4592-a69f-645759acec30 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:10.864479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-29077f15-673f-4592-a69f-645759acec30 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:10.870532 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-29077f15-673f-4592-a69f-645759acec30 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:10.872719 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-29077f15-673f-4592-a69f-645759acec30 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1407 microversion: 2.20 time: 0.629888 Aug 07 22:38:10.877007 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 53/109] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:38:10 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1407 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:38:10.886807 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b0561b92-ce29-4b2d-8ce3-5c12cc1f942f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:10.894029 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-b0561b92-ce29-4b2d-8ce3-5c12cc1f942f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:10.906508 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-e6e9b699-8dba-457c-b491-46d57ddeb0d8 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:10.909162 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b0561b92-ce29-4b2d-8ce3-5c12cc1f942f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:10.909898 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b0561b92-ce29-4b2d-8ce3-5c12cc1f942f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:10.910625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b0561b92-ce29-4b2d-8ce3-5c12cc1f942f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:10.913022 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b0561b92-ce29-4b2d-8ce3-5c12cc1f942f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:10.914052 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-e6e9b699-8dba-457c-b491-46d57ddeb0d8 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.466482 Aug 07 22:38:10.914844 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b0561b92-ce29-4b2d-8ce3-5c12cc1f942f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:10.914998 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 57/110] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:10 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:38:10.929164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b0561b92-ce29-4b2d-8ce3-5c12cc1f942f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:11.158876 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-b0561b92-ce29-4b2d-8ce3-5c12cc1f942f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:11.167543 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-b0561b92-ce29-4b2d-8ce3-5c12cc1f942f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.289278 Aug 07 22:38:11.168141 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 54/111] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:10 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:11.903420 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-a0c82b22-b435-4311-afc6-b645aca58855 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:11.904052 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-a0c82b22-b435-4311-afc6-b645aca58855 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:11.909787 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a0c82b22-b435-4311-afc6-b645aca58855 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:11.912734 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a0c82b22-b435-4311-afc6-b645aca58855 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:11.912734 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a0c82b22-b435-4311-afc6-b645aca58855 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:11.912734 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a0c82b22-b435-4311-afc6-b645aca58855 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:11.912734 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a0c82b22-b435-4311-afc6-b645aca58855 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:11.913067 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a0c82b22-b435-4311-afc6-b645aca58855 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:11.941032 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-af29ea33-6803-48cb-a681-8aa6024819f1 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:11.941746 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-af29ea33-6803-48cb-a681-8aa6024819f1 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:11.954851 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-af29ea33-6803-48cb-a681-8aa6024819f1 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:11.955450 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-af29ea33-6803-48cb-a681-8aa6024819f1 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:11.955905 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-af29ea33-6803-48cb-a681-8aa6024819f1 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:11.957851 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-af29ea33-6803-48cb-a681-8aa6024819f1 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:11.962217 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-af29ea33-6803-48cb-a681-8aa6024819f1 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:11.963162 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-af29ea33-6803-48cb-a681-8aa6024819f1 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:12.131896 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-a0c82b22-b435-4311-afc6-b645aca58855 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:12.142714 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-a0c82b22-b435-4311-afc6-b645aca58855 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:12.144649 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-a0c82b22-b435-4311-afc6-b645aca58855 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:12.149951 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-a0c82b22-b435-4311-afc6-b645aca58855 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1407 microversion: 2.20 time: 0.251904 Aug 07 22:38:12.150575 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 58/112] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:38:11 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:38:12.168052 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-af29ea33-6803-48cb-a681-8aa6024819f1 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:12.175603 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-af29ea33-6803-48cb-a681-8aa6024819f1 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.238522 Aug 07 22:38:12.180319 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 55/113] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:11 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:12.197398 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-0a69eb9d-e349-4f4e-81e5-0ca0b280faa8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:12.198199 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-0a69eb9d-e349-4f4e-81e5-0ca0b280faa8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:12.204711 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0a69eb9d-e349-4f4e-81e5-0ca0b280faa8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:12.205423 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0a69eb9d-e349-4f4e-81e5-0ca0b280faa8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:12.205851 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0a69eb9d-e349-4f4e-81e5-0ca0b280faa8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:12.206722 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0a69eb9d-e349-4f4e-81e5-0ca0b280faa8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:12.207490 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0a69eb9d-e349-4f4e-81e5-0ca0b280faa8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:12.208395 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0a69eb9d-e349-4f4e-81e5-0ca0b280faa8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:12.412096 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-0a69eb9d-e349-4f4e-81e5-0ca0b280faa8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:12.419889 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-0a69eb9d-e349-4f4e-81e5-0ca0b280faa8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.229865 Aug 07 22:38:12.420552 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 59/114] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:12 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:13.087111 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-7e649e91-da12-449b-be8c-368c144aade8 req-feafed30-386e-4958-9336-6e684268616a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e", "name": "network-vif-plugged", "status": "completed", "tag": "8844e27d-a856-4256-bdd2-6ab7f2b8ceda"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:38:13.105422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-7e649e91-da12-449b-be8c-368c144aade8 req-feafed30-386e-4958-9336-6e684268616a service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:13.105422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-7e649e91-da12-449b-be8c-368c144aade8 req-feafed30-386e-4958-9336-6e684268616a service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:13.105422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-7e649e91-da12-449b-be8c-368c144aade8 req-feafed30-386e-4958-9336-6e684268616a service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:13.124371 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-7e649e91-da12-449b-be8c-368c144aade8 req-feafed30-386e-4958-9336-6e684268616a service nova] Creating event network-vif-plugged:8844e27d-a856-4256-bdd2-6ab7f2b8ceda for instance c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e on hv-cinder-85032 Aug 07 22:38:13.128307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-7e649e91-da12-449b-be8c-368c144aade8 req-feafed30-386e-4958-9336-6e684268616a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=129964) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 07 22:38:13.128307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-7e649e91-da12-449b-be8c-368c144aade8 req-feafed30-386e-4958-9336-6e684268616a service nova] Acquired lock "compute-rpcapi-router" {{(pid=129964) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 07 22:38:13.128307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d3eb82ec-a3b5-4cd5-98ba-87d864d0c7a6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:13.128307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d3eb82ec-a3b5-4cd5-98ba-87d864d0c7a6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:13.128307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d3eb82ec-a3b5-4cd5-98ba-87d864d0c7a6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:13.128723 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d3eb82ec-a3b5-4cd5-98ba-87d864d0c7a6 None None] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:13.129117 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d3eb82ec-a3b5-4cd5-98ba-87d864d0c7a6 None None] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:13.129535 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d3eb82ec-a3b5-4cd5-98ba-87d864d0c7a6 None None] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:13.139611 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.compute.rpcapi [None req-d3eb82ec-a3b5-4cd5-98ba-87d864d0c7a6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 07 22:38:13.140514 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d3eb82ec-a3b5-4cd5-98ba-87d864d0c7a6 None None] Releasing lock "compute-rpcapi-router" {{(pid=129964) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 07 22:38:13.157897 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-d3eb82ec-a3b5-4cd5-98ba-87d864d0c7a6 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.369086 Aug 07 22:38:13.158587 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 56/115] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:38:13.173838 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-c67f839b-83ea-4a94-a96d-ad8cb688d496 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:13.174735 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-c67f839b-83ea-4a94-a96d-ad8cb688d496 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:13.181561 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c67f839b-83ea-4a94-a96d-ad8cb688d496 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:13.185642 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c67f839b-83ea-4a94-a96d-ad8cb688d496 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:13.185642 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c67f839b-83ea-4a94-a96d-ad8cb688d496 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:13.185642 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c67f839b-83ea-4a94-a96d-ad8cb688d496 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:13.185642 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c67f839b-83ea-4a94-a96d-ad8cb688d496 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:13.186165 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c67f839b-83ea-4a94-a96d-ad8cb688d496 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:13.203380 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f486e41e-b048-40ae-b5de-c1bcfd2b2a91 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:13.204634 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f486e41e-b048-40ae-b5de-c1bcfd2b2a91 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:13.215127 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f486e41e-b048-40ae-b5de-c1bcfd2b2a91 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:13.216264 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f486e41e-b048-40ae-b5de-c1bcfd2b2a91 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:13.216904 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f486e41e-b048-40ae-b5de-c1bcfd2b2a91 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:13.218029 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f486e41e-b048-40ae-b5de-c1bcfd2b2a91 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:13.218666 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f486e41e-b048-40ae-b5de-c1bcfd2b2a91 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:13.219465 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f486e41e-b048-40ae-b5de-c1bcfd2b2a91 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:13.801154 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f486e41e-b048-40ae-b5de-c1bcfd2b2a91 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:13.809544 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f486e41e-b048-40ae-b5de-c1bcfd2b2a91 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.611743 Aug 07 22:38:13.810118 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 57/116] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:13 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:13.830994 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a9779617-9497-4b71-95b9-81179d9cdeff tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:13.830994 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a9779617-9497-4b71-95b9-81179d9cdeff tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:13.838678 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a9779617-9497-4b71-95b9-81179d9cdeff tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:13.839158 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a9779617-9497-4b71-95b9-81179d9cdeff tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:13.839748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a9779617-9497-4b71-95b9-81179d9cdeff tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:13.840635 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a9779617-9497-4b71-95b9-81179d9cdeff tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:13.841079 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a9779617-9497-4b71-95b9-81179d9cdeff tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:13.841497 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a9779617-9497-4b71-95b9-81179d9cdeff tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:13.855448 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-c67f839b-83ea-4a94-a96d-ad8cb688d496 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:13.865297 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-c67f839b-83ea-4a94-a96d-ad8cb688d496 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:13.866942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-c67f839b-83ea-4a94-a96d-ad8cb688d496 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:13.868734 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-c67f839b-83ea-4a94-a96d-ad8cb688d496 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1407 microversion: 2.20 time: 0.700454 Aug 07 22:38:13.869793 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 60/117] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:38:13 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1407 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:38:14.018642 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-a9779617-9497-4b71-95b9-81179d9cdeff tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:14.027267 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a9779617-9497-4b71-95b9-81179d9cdeff tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.201578 Aug 07 22:38:14.027855 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 58/118] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:13 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:14.830629 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-b8956694-bf76-4f52-83f6-f0946aa50810 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:14.831293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-b8956694-bf76-4f52-83f6-f0946aa50810 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:14.838086 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b8956694-bf76-4f52-83f6-f0946aa50810 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:14.839291 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b8956694-bf76-4f52-83f6-f0946aa50810 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:14.841028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b8956694-bf76-4f52-83f6-f0946aa50810 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:14.841028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b8956694-bf76-4f52-83f6-f0946aa50810 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:14.841345 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b8956694-bf76-4f52-83f6-f0946aa50810 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:14.841829 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b8956694-bf76-4f52-83f6-f0946aa50810 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:14.908412 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-50e5d478-401b-4874-b418-c9826c7c67b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:14.909610 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-50e5d478-401b-4874-b418-c9826c7c67b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:14.916940 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-50e5d478-401b-4874-b418-c9826c7c67b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:14.917674 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-50e5d478-401b-4874-b418-c9826c7c67b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:14.918542 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-50e5d478-401b-4874-b418-c9826c7c67b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:14.919388 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-50e5d478-401b-4874-b418-c9826c7c67b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:14.920542 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-50e5d478-401b-4874-b418-c9826c7c67b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:14.921142 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-50e5d478-401b-4874-b418-c9826c7c67b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:15.018068 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-b8956694-bf76-4f52-83f6-f0946aa50810 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:15.042713 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-b8956694-bf76-4f52-83f6-f0946aa50810 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.215669 Aug 07 22:38:15.044261 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 61/119] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:14 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:15.063063 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-53317223-aca2-42f6-9d4b-8ee29a14c136 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:15.063180 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-53317223-aca2-42f6-9d4b-8ee29a14c136 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:15.073097 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-53317223-aca2-42f6-9d4b-8ee29a14c136 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:15.076469 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-53317223-aca2-42f6-9d4b-8ee29a14c136 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:15.076469 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-53317223-aca2-42f6-9d4b-8ee29a14c136 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:15.077238 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-53317223-aca2-42f6-9d4b-8ee29a14c136 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:15.077705 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-53317223-aca2-42f6-9d4b-8ee29a14c136 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:15.078127 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-53317223-aca2-42f6-9d4b-8ee29a14c136 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:15.101730 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-50e5d478-401b-4874-b418-c9826c7c67b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:15.119017 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-50e5d478-401b-4874-b418-c9826c7c67b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:15.121768 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-50e5d478-401b-4874-b418-c9826c7c67b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:15.124942 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-50e5d478-401b-4874-b418-c9826c7c67b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1407 microversion: 2.20 time: 0.229646 Aug 07 22:38:15.125871 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 59/120] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:38:14 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:38:15.175150 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-aeeac85f-8394-4268-9aae-3fc87aa51331 req-f4c71560-095a-42ba-b274-8601eab25da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e2c1f8-3d85-437e-9c51-805820cfa4a7", "name": "network-vif-plugged", "status": "completed", "tag": "ee8dc2da-5ffd-43e1-a446-69c9b4634a95"}, {"server_uuid": "39340b52-40cd-4de1-a055-2ad5d71a6598", "name": "network-vif-plugged", "status": "completed", "tag": "3ebb913e-d05d-414e-9214-6fe46a403f13"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:38:15.192263 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-aeeac85f-8394-4268-9aae-3fc87aa51331 req-f4c71560-095a-42ba-b274-8601eab25da3 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:15.192737 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-aeeac85f-8394-4268-9aae-3fc87aa51331 req-f4c71560-095a-42ba-b274-8601eab25da3 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:15.193165 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-aeeac85f-8394-4268-9aae-3fc87aa51331 req-f4c71560-095a-42ba-b274-8601eab25da3 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:15.215714 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-aeeac85f-8394-4268-9aae-3fc87aa51331 req-f4c71560-095a-42ba-b274-8601eab25da3 service nova] Creating event network-vif-plugged:ee8dc2da-5ffd-43e1-a446-69c9b4634a95 for instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 on hv-cinder-85032 Aug 07 22:38:15.217142 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-aeeac85f-8394-4268-9aae-3fc87aa51331 req-f4c71560-095a-42ba-b274-8601eab25da3 service nova] Creating event network-vif-plugged:3ebb913e-d05d-414e-9214-6fe46a403f13 for instance 39340b52-40cd-4de1-a055-2ad5d71a6598 on hv-cinder-85032 Aug 07 22:38:15.224516 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-aeeac85f-8394-4268-9aae-3fc87aa51331 req-f4c71560-095a-42ba-b274-8601eab25da3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052861 Aug 07 22:38:15.237997 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 60/121] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:38:15.272987 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-53317223-aca2-42f6-9d4b-8ee29a14c136 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:15.285638 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-53317223-aca2-42f6-9d4b-8ee29a14c136 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.239464 Aug 07 22:38:15.288153 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 62/122] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:15 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:16.069406 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-79e72f03-e472-449d-a9d3-52f038d5ecba tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:16.071377 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-79e72f03-e472-449d-a9d3-52f038d5ecba tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:16.078535 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-79e72f03-e472-449d-a9d3-52f038d5ecba tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:16.079269 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-79e72f03-e472-449d-a9d3-52f038d5ecba tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:16.079779 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-79e72f03-e472-449d-a9d3-52f038d5ecba tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:16.080577 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-79e72f03-e472-449d-a9d3-52f038d5ecba tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:16.081101 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-79e72f03-e472-449d-a9d3-52f038d5ecba tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:16.081592 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-79e72f03-e472-449d-a9d3-52f038d5ecba tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:16.150916 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-417e1747-f2b8-44b3-b83a-6cb3c016d0d4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:16.151567 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-417e1747-f2b8-44b3-b83a-6cb3c016d0d4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:16.157538 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-417e1747-f2b8-44b3-b83a-6cb3c016d0d4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:16.158016 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-417e1747-f2b8-44b3-b83a-6cb3c016d0d4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:16.158444 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-417e1747-f2b8-44b3-b83a-6cb3c016d0d4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:16.159130 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-417e1747-f2b8-44b3-b83a-6cb3c016d0d4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:16.159576 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-417e1747-f2b8-44b3-b83a-6cb3c016d0d4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:16.159996 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-417e1747-f2b8-44b3-b83a-6cb3c016d0d4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:16.248518 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-79e72f03-e472-449d-a9d3-52f038d5ecba tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:16.256342 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-79e72f03-e472-449d-a9d3-52f038d5ecba tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.191676 Aug 07 22:38:16.256963 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 61/123] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:16 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:16.310741 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-3ef6c557-20db-4f79-9546-4e2010e7edd4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:16.311348 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-3ef6c557-20db-4f79-9546-4e2010e7edd4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:16.316423 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-417e1747-f2b8-44b3-b83a-6cb3c016d0d4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:16.317815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3ef6c557-20db-4f79-9546-4e2010e7edd4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:16.318288 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3ef6c557-20db-4f79-9546-4e2010e7edd4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:16.318747 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3ef6c557-20db-4f79-9546-4e2010e7edd4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:16.319428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3ef6c557-20db-4f79-9546-4e2010e7edd4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:16.319869 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3ef6c557-20db-4f79-9546-4e2010e7edd4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:16.320399 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3ef6c557-20db-4f79-9546-4e2010e7edd4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:16.337450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-417e1747-f2b8-44b3-b83a-6cb3c016d0d4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:16.338947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-417e1747-f2b8-44b3-b83a-6cb3c016d0d4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:16.340253 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-417e1747-f2b8-44b3-b83a-6cb3c016d0d4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1407 microversion: 2.20 time: 0.193408 Aug 07 22:38:16.340981 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 63/124] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:38:16 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:38:16.463865 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-3ef6c557-20db-4f79-9546-4e2010e7edd4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:16.471681 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-3ef6c557-20db-4f79-9546-4e2010e7edd4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.164743 Aug 07 22:38:16.472063 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 62/125] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:16 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:17.279410 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-53f76ae1-d697-4721-87c9-343dfa66aaf3 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:17.280052 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-53f76ae1-d697-4721-87c9-343dfa66aaf3 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:17.286863 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-53f76ae1-d697-4721-87c9-343dfa66aaf3 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:17.287630 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-53f76ae1-d697-4721-87c9-343dfa66aaf3 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:17.288469 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-53f76ae1-d697-4721-87c9-343dfa66aaf3 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:17.289328 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-53f76ae1-d697-4721-87c9-343dfa66aaf3 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:17.289856 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-53f76ae1-d697-4721-87c9-343dfa66aaf3 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:17.290355 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-53f76ae1-d697-4721-87c9-343dfa66aaf3 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:17.371515 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a6e58f63-8883-49a4-9c24-95db879cb27e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:17.372166 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a6e58f63-8883-49a4-9c24-95db879cb27e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:17.378039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a6e58f63-8883-49a4-9c24-95db879cb27e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:17.378580 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a6e58f63-8883-49a4-9c24-95db879cb27e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:17.379012 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a6e58f63-8883-49a4-9c24-95db879cb27e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:17.379697 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a6e58f63-8883-49a4-9c24-95db879cb27e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:17.380176 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a6e58f63-8883-49a4-9c24-95db879cb27e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:17.380759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a6e58f63-8883-49a4-9c24-95db879cb27e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:17.440126 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-53f76ae1-d697-4721-87c9-343dfa66aaf3 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:17.450039 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-53f76ae1-d697-4721-87c9-343dfa66aaf3 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.175531 Aug 07 22:38:17.464572 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 64/126] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:17 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:17.492822 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-9c72efea-709c-4fa2-a3a3-335603ff59f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:17.493668 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-9c72efea-709c-4fa2-a3a3-335603ff59f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:17.500455 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9c72efea-709c-4fa2-a3a3-335603ff59f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:17.501101 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9c72efea-709c-4fa2-a3a3-335603ff59f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:17.501695 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9c72efea-709c-4fa2-a3a3-335603ff59f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:17.502518 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9c72efea-709c-4fa2-a3a3-335603ff59f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:17.503104 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9c72efea-709c-4fa2-a3a3-335603ff59f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:17.503662 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9c72efea-709c-4fa2-a3a3-335603ff59f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:17.555029 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-a6e58f63-8883-49a4-9c24-95db879cb27e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:17.563298 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-a6e58f63-8883-49a4-9c24-95db879cb27e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:17.565030 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-a6e58f63-8883-49a4-9c24-95db879cb27e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:17.566117 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a6e58f63-8883-49a4-9c24-95db879cb27e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1407 microversion: 2.20 time: 0.199971 Aug 07 22:38:17.566675 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 63/127] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:38:17 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:38:17.647870 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-9c72efea-709c-4fa2-a3a3-335603ff59f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:17.656416 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-9c72efea-709c-4fa2-a3a3-335603ff59f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.168221 Aug 07 22:38:17.668878 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 65/128] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:17 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:38:18.380590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-c4452783-4a47-4d94-abcc-adafb815a685 req-fbb9ff7d-363e-4341-8de9-406e21481ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bda9470-bb0f-45e2-9f1b-e4d1db51aeba", "name": "network-vif-plugged", "status": "completed", "tag": "1f737453-339e-4e1d-8c0b-b401edea34b1"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:38:18.393707 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-c4452783-4a47-4d94-abcc-adafb815a685 req-fbb9ff7d-363e-4341-8de9-406e21481ca3 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:18.394196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-c4452783-4a47-4d94-abcc-adafb815a685 req-fbb9ff7d-363e-4341-8de9-406e21481ca3 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:18.394617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-c4452783-4a47-4d94-abcc-adafb815a685 req-fbb9ff7d-363e-4341-8de9-406e21481ca3 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:18.407167 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-c4452783-4a47-4d94-abcc-adafb815a685 req-fbb9ff7d-363e-4341-8de9-406e21481ca3 service nova] Creating event network-vif-plugged:1f737453-339e-4e1d-8c0b-b401edea34b1 for instance 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba on hv-cinder-85032 Aug 07 22:38:18.416124 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-c4452783-4a47-4d94-abcc-adafb815a685 req-fbb9ff7d-363e-4341-8de9-406e21481ca3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039872 Aug 07 22:38:18.416733 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 64/129] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:38:18.471692 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-a06eacd4-e89f-4efd-bed3-b8b4c65c4ced tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:18.472382 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-a06eacd4-e89f-4efd-bed3-b8b4c65c4ced tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:18.478733 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a06eacd4-e89f-4efd-bed3-b8b4c65c4ced tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:18.479212 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a06eacd4-e89f-4efd-bed3-b8b4c65c4ced tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:18.479642 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a06eacd4-e89f-4efd-bed3-b8b4c65c4ced tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:18.480969 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a06eacd4-e89f-4efd-bed3-b8b4c65c4ced tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:18.481479 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a06eacd4-e89f-4efd-bed3-b8b4c65c4ced tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:18.481908 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a06eacd4-e89f-4efd-bed3-b8b4c65c4ced tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:18.599399 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-9f602a1f-2a06-4858-8143-69d675122e6d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:18.600083 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-9f602a1f-2a06-4858-8143-69d675122e6d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:18.609497 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9f602a1f-2a06-4858-8143-69d675122e6d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:18.610376 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9f602a1f-2a06-4858-8143-69d675122e6d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:18.610997 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9f602a1f-2a06-4858-8143-69d675122e6d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:18.612715 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9f602a1f-2a06-4858-8143-69d675122e6d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:18.613319 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9f602a1f-2a06-4858-8143-69d675122e6d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:18.613899 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9f602a1f-2a06-4858-8143-69d675122e6d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:18.668954 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-a06eacd4-e89f-4efd-bed3-b8b4c65c4ced tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:18.677823 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-a06eacd4-e89f-4efd-bed3-b8b4c65c4ced tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.209194 Aug 07 22:38:18.680237 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 66/130] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:18 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:18.685783 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-a42c3f44-9151-4ef7-9aad-3ff50eef1b20 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:18.688063 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-a42c3f44-9151-4ef7-9aad-3ff50eef1b20 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:18.698328 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a42c3f44-9151-4ef7-9aad-3ff50eef1b20 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:18.698837 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a42c3f44-9151-4ef7-9aad-3ff50eef1b20 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:18.705282 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a42c3f44-9151-4ef7-9aad-3ff50eef1b20 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:18.705282 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a42c3f44-9151-4ef7-9aad-3ff50eef1b20 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:18.705282 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a42c3f44-9151-4ef7-9aad-3ff50eef1b20 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:18.705282 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a42c3f44-9151-4ef7-9aad-3ff50eef1b20 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:18.928192 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-9f602a1f-2a06-4858-8143-69d675122e6d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:18.955101 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-9f602a1f-2a06-4858-8143-69d675122e6d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:18.956663 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-9f602a1f-2a06-4858-8143-69d675122e6d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:18.964413 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-9f602a1f-2a06-4858-8143-69d675122e6d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1407 microversion: 2.20 time: 0.378506 Aug 07 22:38:18.972798 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-a42c3f44-9151-4ef7-9aad-3ff50eef1b20 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:18.977715 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 65/131] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:38:18 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1407 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:38:18.996943 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-a42c3f44-9151-4ef7-9aad-3ff50eef1b20 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.313952 Aug 07 22:38:18.998344 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 67/132] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:18 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:19.702355 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-1b95397d-bc76-4716-87ae-89c22651b63c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:19.703071 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-1b95397d-bc76-4716-87ae-89c22651b63c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:19.709534 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1b95397d-bc76-4716-87ae-89c22651b63c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:19.710290 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1b95397d-bc76-4716-87ae-89c22651b63c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:19.711227 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1b95397d-bc76-4716-87ae-89c22651b63c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:19.712203 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1b95397d-bc76-4716-87ae-89c22651b63c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:19.712762 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1b95397d-bc76-4716-87ae-89c22651b63c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:19.713209 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1b95397d-bc76-4716-87ae-89c22651b63c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:19.855582 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-1b95397d-bc76-4716-87ae-89c22651b63c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:19.874244 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-1b95397d-bc76-4716-87ae-89c22651b63c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1314 microversion: 2.1 time: 0.173566 Aug 07 22:38:19.875376 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 66/133] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:19 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:19.994171 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-cd4735a1-490e-4fea-bd7e-435fcd5d13a9 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:19.994767 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-cd4735a1-490e-4fea-bd7e-435fcd5d13a9 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:20.000693 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cd4735a1-490e-4fea-bd7e-435fcd5d13a9 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:20.001160 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cd4735a1-490e-4fea-bd7e-435fcd5d13a9 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:20.001584 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cd4735a1-490e-4fea-bd7e-435fcd5d13a9 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:20.006464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cd4735a1-490e-4fea-bd7e-435fcd5d13a9 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:20.007342 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cd4735a1-490e-4fea-bd7e-435fcd5d13a9 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:20.008522 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cd4735a1-490e-4fea-bd7e-435fcd5d13a9 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:20.028549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-6b6afdc7-4571-490d-8600-d6752da6236a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:20.038601 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-6b6afdc7-4571-490d-8600-d6752da6236a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:20.061839 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6b6afdc7-4571-490d-8600-d6752da6236a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:20.061839 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6b6afdc7-4571-490d-8600-d6752da6236a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:20.061839 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6b6afdc7-4571-490d-8600-d6752da6236a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:20.065046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6b6afdc7-4571-490d-8600-d6752da6236a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:20.065553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6b6afdc7-4571-490d-8600-d6752da6236a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:20.066027 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6b6afdc7-4571-490d-8600-d6752da6236a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:20.319266 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-cd4735a1-490e-4fea-bd7e-435fcd5d13a9 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:20.328829 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-cd4735a1-490e-4fea-bd7e-435fcd5d13a9 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:20.330348 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-cd4735a1-490e-4fea-bd7e-435fcd5d13a9 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:20.337908 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-cd4735a1-490e-4fea-bd7e-435fcd5d13a9 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1407 microversion: 2.20 time: 0.347696 Aug 07 22:38:20.338850 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 68/134] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:38:19 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1407 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:38:20.349319 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-6b6afdc7-4571-490d-8600-d6752da6236a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:20.359669 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-6b6afdc7-4571-490d-8600-d6752da6236a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1321 microversion: 2.1 time: 0.336066 Aug 07 22:38:20.359669 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 67/135] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:20 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1321 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:38:20.895038 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-a7e86c41-84e7-44c2-96de-05a7965005ac tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:20.895640 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-a7e86c41-84e7-44c2-96de-05a7965005ac tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:20.905778 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a7e86c41-84e7-44c2-96de-05a7965005ac tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:20.906262 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a7e86c41-84e7-44c2-96de-05a7965005ac tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:20.906685 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a7e86c41-84e7-44c2-96de-05a7965005ac tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:20.907367 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a7e86c41-84e7-44c2-96de-05a7965005ac tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:20.907808 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a7e86c41-84e7-44c2-96de-05a7965005ac tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:20.908261 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a7e86c41-84e7-44c2-96de-05a7965005ac tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:21.068627 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-a7e86c41-84e7-44c2-96de-05a7965005ac tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:21.082449 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-a7e86c41-84e7-44c2-96de-05a7965005ac tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1500 microversion: 2.1 time: 0.191446 Aug 07 22:38:21.083691 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 69/136] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:20 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1500 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:21.360704 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-988f7d13-d332-4014-8b91-a22eb5d0fc2d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:21.368443 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-988f7d13-d332-4014-8b91-a22eb5d0fc2d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:21.383603 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-988f7d13-d332-4014-8b91-a22eb5d0fc2d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:21.384531 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-988f7d13-d332-4014-8b91-a22eb5d0fc2d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:21.384729 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-3b7e02df-0653-4da1-b332-107560587164 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:21.385308 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-988f7d13-d332-4014-8b91-a22eb5d0fc2d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:21.385478 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-3b7e02df-0653-4da1-b332-107560587164 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:21.386359 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-988f7d13-d332-4014-8b91-a22eb5d0fc2d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:21.386952 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-988f7d13-d332-4014-8b91-a22eb5d0fc2d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:21.387539 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-988f7d13-d332-4014-8b91-a22eb5d0fc2d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:21.398090 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3b7e02df-0653-4da1-b332-107560587164 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:21.399455 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3b7e02df-0653-4da1-b332-107560587164 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:21.400115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3b7e02df-0653-4da1-b332-107560587164 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:21.402075 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3b7e02df-0653-4da1-b332-107560587164 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:21.403114 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3b7e02df-0653-4da1-b332-107560587164 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:21.403551 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3b7e02df-0653-4da1-b332-107560587164 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:21.628414 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-988f7d13-d332-4014-8b91-a22eb5d0fc2d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:21.632351 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-3b7e02df-0653-4da1-b332-107560587164 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:21.639091 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-988f7d13-d332-4014-8b91-a22eb5d0fc2d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:21.640877 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-988f7d13-d332-4014-8b91-a22eb5d0fc2d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:21.641236 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-3b7e02df-0653-4da1-b332-107560587164 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1515 microversion: 2.1 time: 0.264283 Aug 07 22:38:21.641849 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 70/137] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:21 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1515 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:21.642122 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-988f7d13-d332-4014-8b91-a22eb5d0fc2d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1407 microversion: 2.20 time: 0.285473 Aug 07 22:38:21.642667 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 68/138] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:38:21 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:38:21.662640 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-f8f6cfb0-1532-41b9-b55a-f8b8752be8ad tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:38:21.665074 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-f8f6cfb0-1532-41b9-b55a-f8b8752be8ad tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:21.671054 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f8f6cfb0-1532-41b9-b55a-f8b8752be8ad tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:21.671533 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f8f6cfb0-1532-41b9-b55a-f8b8752be8ad tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:21.675704 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f8f6cfb0-1532-41b9-b55a-f8b8752be8ad tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:21.675704 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f8f6cfb0-1532-41b9-b55a-f8b8752be8ad tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:21.675704 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f8f6cfb0-1532-41b9-b55a-f8b8752be8ad tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:21.675704 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f8f6cfb0-1532-41b9-b55a-f8b8752be8ad tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:21.744210 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.objects.instance [None req-f8f6cfb0-1532-41b9-b55a-f8b8752be8ad tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lazy-loading 'flavor' on Instance uuid 39340b52-40cd-4de1-a055-2ad5d71a6598 {{(pid=129965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:38:21.922437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:38:22.106507 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-f8f6cfb0-1532-41b9-b55a-f8b8752be8ad tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "POST /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598/action" status: 200 len: 32 microversion: 2.1 time: 0.442195 Aug 07 22:38:22.106507 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 71/139] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 22:38:21 2022] POST /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598/action => generated 32 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 07 22:38:22.111697 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-04af1e1c-16f1-4cc5-ba66-13b5e726ee5f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:22.112345 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-04af1e1c-16f1-4cc5-ba66-13b5e726ee5f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:22.119095 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-04af1e1c-16f1-4cc5-ba66-13b5e726ee5f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:22.119592 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-04af1e1c-16f1-4cc5-ba66-13b5e726ee5f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:22.120055 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-04af1e1c-16f1-4cc5-ba66-13b5e726ee5f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:22.120740 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-04af1e1c-16f1-4cc5-ba66-13b5e726ee5f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:22.121189 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-04af1e1c-16f1-4cc5-ba66-13b5e726ee5f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:22.121672 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-04af1e1c-16f1-4cc5-ba66-13b5e726ee5f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:22.149692 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=100 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:38:22.275634 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-04af1e1c-16f1-4cc5-ba66-13b5e726ee5f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:22.283408 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-04af1e1c-16f1-4cc5-ba66-13b5e726ee5f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.175647 Aug 07 22:38:22.284077 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 69/140] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:22 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:22.666045 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-b71af665-40ef-42d4-a968-1daac56a1e7a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:22.666810 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-b71af665-40ef-42d4-a968-1daac56a1e7a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:22.673767 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b71af665-40ef-42d4-a968-1daac56a1e7a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:22.674249 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b71af665-40ef-42d4-a968-1daac56a1e7a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:22.674677 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b71af665-40ef-42d4-a968-1daac56a1e7a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:22.675390 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b71af665-40ef-42d4-a968-1daac56a1e7a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:22.675833 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b71af665-40ef-42d4-a968-1daac56a1e7a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:22.676276 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b71af665-40ef-42d4-a968-1daac56a1e7a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:22.857476 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-b71af665-40ef-42d4-a968-1daac56a1e7a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:22.866140 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-b71af665-40ef-42d4-a968-1daac56a1e7a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:22.869470 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-b71af665-40ef-42d4-a968-1daac56a1e7a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:22.870588 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-b71af665-40ef-42d4-a968-1daac56a1e7a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1407 microversion: 2.20 time: 0.209811 Aug 07 22:38:22.877057 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 72/141] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:38:22 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:38:23.305145 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-ad148e5e-ab34-46d0-a1d3-03c494403ea7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:23.305751 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-ad148e5e-ab34-46d0-a1d3-03c494403ea7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:23.307541 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=2 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:38:23.312504 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ad148e5e-ab34-46d0-a1d3-03c494403ea7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:23.312988 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ad148e5e-ab34-46d0-a1d3-03c494403ea7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:23.313422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ad148e5e-ab34-46d0-a1d3-03c494403ea7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:23.314105 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ad148e5e-ab34-46d0-a1d3-03c494403ea7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:23.314557 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ad148e5e-ab34-46d0-a1d3-03c494403ea7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:23.316271 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ad148e5e-ab34-46d0-a1d3-03c494403ea7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:23.468829 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-ad148e5e-ab34-46d0-a1d3-03c494403ea7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:23.476854 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-ad148e5e-ab34-46d0-a1d3-03c494403ea7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.175944 Aug 07 22:38:23.477428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 70/142] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:23 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:23.894489 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ae5ff4a9-6648-47df-998e-0610d99ed14e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:23.895834 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-ae5ff4a9-6648-47df-998e-0610d99ed14e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:23.906087 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ae5ff4a9-6648-47df-998e-0610d99ed14e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:23.906087 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ae5ff4a9-6648-47df-998e-0610d99ed14e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:23.906087 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ae5ff4a9-6648-47df-998e-0610d99ed14e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:23.906087 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ae5ff4a9-6648-47df-998e-0610d99ed14e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:23.906427 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ae5ff4a9-6648-47df-998e-0610d99ed14e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:23.906647 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ae5ff4a9-6648-47df-998e-0610d99ed14e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:24.065021 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-ae5ff4a9-6648-47df-998e-0610d99ed14e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:24.074502 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-ae5ff4a9-6648-47df-998e-0610d99ed14e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:24.077152 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-ae5ff4a9-6648-47df-998e-0610d99ed14e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:24.077439 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-ae5ff4a9-6648-47df-998e-0610d99ed14e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1407 microversion: 2.20 time: 0.187297 Aug 07 22:38:24.092647 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 73/143] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:38:23 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:38:24.498912 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-175c0890-469a-400f-b781-839185a14957 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:24.499511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-175c0890-469a-400f-b781-839185a14957 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:24.505450 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-175c0890-469a-400f-b781-839185a14957 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:24.505926 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-175c0890-469a-400f-b781-839185a14957 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:24.506357 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-175c0890-469a-400f-b781-839185a14957 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:24.507346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-175c0890-469a-400f-b781-839185a14957 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:24.508323 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-175c0890-469a-400f-b781-839185a14957 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:24.508742 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-175c0890-469a-400f-b781-839185a14957 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:24.639499 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-175c0890-469a-400f-b781-839185a14957 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:24.647118 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-175c0890-469a-400f-b781-839185a14957 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.152572 Aug 07 22:38:24.647870 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 71/144] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:24 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:25.100257 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-3d694a1b-c498-4104-89c4-3e4219d136a3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:25.100928 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-3d694a1b-c498-4104-89c4-3e4219d136a3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:25.108293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3d694a1b-c498-4104-89c4-3e4219d136a3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:25.108984 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3d694a1b-c498-4104-89c4-3e4219d136a3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:25.109203 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3d694a1b-c498-4104-89c4-3e4219d136a3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:25.110045 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3d694a1b-c498-4104-89c4-3e4219d136a3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:25.110403 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3d694a1b-c498-4104-89c4-3e4219d136a3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:25.110825 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3d694a1b-c498-4104-89c4-3e4219d136a3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:25.298866 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-3d694a1b-c498-4104-89c4-3e4219d136a3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:25.308324 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-3d694a1b-c498-4104-89c4-3e4219d136a3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:25.309950 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-3d694a1b-c498-4104-89c4-3e4219d136a3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:25.311078 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-3d694a1b-c498-4104-89c4-3e4219d136a3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1407 microversion: 2.20 time: 0.214839 Aug 07 22:38:25.311869 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 74/145] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:38:25 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:38:25.667958 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-080cfc23-22cb-4a87-a7e3-ca3a26d32f32 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:25.669368 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-080cfc23-22cb-4a87-a7e3-ca3a26d32f32 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:25.677578 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-080cfc23-22cb-4a87-a7e3-ca3a26d32f32 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:25.679782 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-080cfc23-22cb-4a87-a7e3-ca3a26d32f32 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:25.679782 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-080cfc23-22cb-4a87-a7e3-ca3a26d32f32 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:25.680351 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-080cfc23-22cb-4a87-a7e3-ca3a26d32f32 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:25.680941 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-080cfc23-22cb-4a87-a7e3-ca3a26d32f32 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:25.681376 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-080cfc23-22cb-4a87-a7e3-ca3a26d32f32 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:25.946067 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-080cfc23-22cb-4a87-a7e3-ca3a26d32f32 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:25.946067 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-080cfc23-22cb-4a87-a7e3-ca3a26d32f32 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.214382 Aug 07 22:38:25.946067 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 72/146] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:25 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:26.031489 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-50f34375-acb0-4e6a-99d7-a6884b3bc5a3 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f2234f7-89e2-4858-9c9d-4ef63cfdd9db"}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:38:26.033798 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-50f34375-acb0-4e6a-99d7-a6884b3bc5a3 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:26.040593 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-50f34375-acb0-4e6a-99d7-a6884b3bc5a3 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:26.041270 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-50f34375-acb0-4e6a-99d7-a6884b3bc5a3 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:26.041865 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-50f34375-acb0-4e6a-99d7-a6884b3bc5a3 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:26.042705 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-50f34375-acb0-4e6a-99d7-a6884b3bc5a3 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:26.043490 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-50f34375-acb0-4e6a-99d7-a6884b3bc5a3 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:26.044091 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-50f34375-acb0-4e6a-99d7-a6884b3bc5a3 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:26.334860 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-74064e20-bf49-48c5-a5b3-8e531a5ee010 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:26.337752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-74064e20-bf49-48c5-a5b3-8e531a5ee010 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:26.362839 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-74064e20-bf49-48c5-a5b3-8e531a5ee010 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:26.363343 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-74064e20-bf49-48c5-a5b3-8e531a5ee010 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:26.363779 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-74064e20-bf49-48c5-a5b3-8e531a5ee010 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:26.364507 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-74064e20-bf49-48c5-a5b3-8e531a5ee010 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:26.366119 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-74064e20-bf49-48c5-a5b3-8e531a5ee010 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:26.366721 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-74064e20-bf49-48c5-a5b3-8e531a5ee010 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:26.580206 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-74064e20-bf49-48c5-a5b3-8e531a5ee010 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:26.595381 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-74064e20-bf49-48c5-a5b3-8e531a5ee010 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:26.597017 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-74064e20-bf49-48c5-a5b3-8e531a5ee010 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:26.598301 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-74064e20-bf49-48c5-a5b3-8e531a5ee010 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1598 microversion: 2.20 time: 0.268730 Aug 07 22:38:26.598987 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 73/147] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:38:26 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1598 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:38:26.624636 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-27e2364d-b4b8-4cbb-937c-2d8685db5580 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:26.625120 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-27e2364d-b4b8-4cbb-937c-2d8685db5580 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:26.630868 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-27e2364d-b4b8-4cbb-937c-2d8685db5580 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:26.631344 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-27e2364d-b4b8-4cbb-937c-2d8685db5580 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:26.631766 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-27e2364d-b4b8-4cbb-937c-2d8685db5580 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:26.633121 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-27e2364d-b4b8-4cbb-937c-2d8685db5580 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:26.633733 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-27e2364d-b4b8-4cbb-937c-2d8685db5580 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:26.634146 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-27e2364d-b4b8-4cbb-937c-2d8685db5580 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:26.782053 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-27e2364d-b4b8-4cbb-937c-2d8685db5580 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.160612 Aug 07 22:38:26.792761 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 74/148] 10.222.0.30 () {60 vars in 1316 bytes} [Sun Aug 7 22:38:26 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 22:38:26.900581 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-11224edb-3863-44d1-a62e-ddc92cd51389 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:26.901623 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-11224edb-3863-44d1-a62e-ddc92cd51389 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:26.908036 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-11224edb-3863-44d1-a62e-ddc92cd51389 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:26.910837 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-11224edb-3863-44d1-a62e-ddc92cd51389 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:26.910837 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-11224edb-3863-44d1-a62e-ddc92cd51389 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:26.910837 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-11224edb-3863-44d1-a62e-ddc92cd51389 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:26.910837 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-11224edb-3863-44d1-a62e-ddc92cd51389 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:26.911196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-11224edb-3863-44d1-a62e-ddc92cd51389 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:27.109099 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-11224edb-3863-44d1-a62e-ddc92cd51389 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:27.112209 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-11224edb-3863-44d1-a62e-ddc92cd51389 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.217282 Aug 07 22:38:27.113473 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 75/149] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:26 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:38:28.139694 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-ed074d86-704d-4b96-893d-62e3b56dd94f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:28.139694 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-ed074d86-704d-4b96-893d-62e3b56dd94f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:28.139694 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_api:SELECT=77 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:38:28.146697 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ed074d86-704d-4b96-893d-62e3b56dd94f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:28.147428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ed074d86-704d-4b96-893d-62e3b56dd94f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:28.148180 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ed074d86-704d-4b96-893d-62e3b56dd94f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:28.149365 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ed074d86-704d-4b96-893d-62e3b56dd94f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:28.150203 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ed074d86-704d-4b96-893d-62e3b56dd94f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:28.150772 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ed074d86-704d-4b96-893d-62e3b56dd94f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:28.354771 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-ed074d86-704d-4b96-893d-62e3b56dd94f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:28.364607 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-ed074d86-704d-4b96-893d-62e3b56dd94f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.234967 Aug 07 22:38:28.367893 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 76/150] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:28 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:28.371522 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-c8c372d2-a5ac-419a-b4c0-a2fc53e20ed9 req-b0f8b0d8-08b0-4e28-89ce-e136b9564c66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bda9470-bb0f-45e2-9f1b-e4d1db51aeba", "tag": "1f737453-339e-4e1d-8c0b-b401edea34b1"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:38:28.382355 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-c8c372d2-a5ac-419a-b4c0-a2fc53e20ed9 req-b0f8b0d8-08b0-4e28-89ce-e136b9564c66 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:28.383164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-c8c372d2-a5ac-419a-b4c0-a2fc53e20ed9 req-b0f8b0d8-08b0-4e28-89ce-e136b9564c66 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:28.383800 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-c8c372d2-a5ac-419a-b4c0-a2fc53e20ed9 req-b0f8b0d8-08b0-4e28-89ce-e136b9564c66 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:28.395176 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-c8c372d2-a5ac-419a-b4c0-a2fc53e20ed9 req-b0f8b0d8-08b0-4e28-89ce-e136b9564c66 service nova] Creating event network-changed:1f737453-339e-4e1d-8c0b-b401edea34b1 for instance 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba on hv-cinder-85032 Aug 07 22:38:28.400847 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-c8c372d2-a5ac-419a-b4c0-a2fc53e20ed9 req-b0f8b0d8-08b0-4e28-89ce-e136b9564c66 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034347 Aug 07 22:38:28.406014 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 77/151] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:38:29.387324 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-9145c781-f057-43b3-a0be-dc24e6cbee56 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:29.387999 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-9145c781-f057-43b3-a0be-dc24e6cbee56 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:29.394490 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9145c781-f057-43b3-a0be-dc24e6cbee56 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:29.394971 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9145c781-f057-43b3-a0be-dc24e6cbee56 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:29.395425 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9145c781-f057-43b3-a0be-dc24e6cbee56 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:29.396234 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9145c781-f057-43b3-a0be-dc24e6cbee56 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:29.396754 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9145c781-f057-43b3-a0be-dc24e6cbee56 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:29.397228 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9145c781-f057-43b3-a0be-dc24e6cbee56 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:29.545580 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-9145c781-f057-43b3-a0be-dc24e6cbee56 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:29.557686 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-9145c781-f057-43b3-a0be-dc24e6cbee56 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.174989 Aug 07 22:38:29.559364 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 78/152] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:29 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:38:30.580995 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-1d069e76-0f9c-4717-9345-0156a46686cf tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:30.582528 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-1d069e76-0f9c-4717-9345-0156a46686cf tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:30.588889 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1d069e76-0f9c-4717-9345-0156a46686cf tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:30.589448 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1d069e76-0f9c-4717-9345-0156a46686cf tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:30.590046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1d069e76-0f9c-4717-9345-0156a46686cf tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:30.590856 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1d069e76-0f9c-4717-9345-0156a46686cf tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:30.591256 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1d069e76-0f9c-4717-9345-0156a46686cf tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:30.591678 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1d069e76-0f9c-4717-9345-0156a46686cf tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:30.725409 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-1d069e76-0f9c-4717-9345-0156a46686cf tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:30.734634 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-1d069e76-0f9c-4717-9345-0156a46686cf tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.158463 Aug 07 22:38:30.738828 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 79/153] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:30 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:38:31.759292 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-353f0da0-3e7a-40b4-8269-42d939409b74 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:31.759931 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-353f0da0-3e7a-40b4-8269-42d939409b74 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:31.766800 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-353f0da0-3e7a-40b4-8269-42d939409b74 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:31.767291 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-353f0da0-3e7a-40b4-8269-42d939409b74 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:31.767724 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-353f0da0-3e7a-40b4-8269-42d939409b74 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:31.768650 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-353f0da0-3e7a-40b4-8269-42d939409b74 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:31.769255 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-353f0da0-3e7a-40b4-8269-42d939409b74 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:31.770047 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-353f0da0-3e7a-40b4-8269-42d939409b74 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:32.087854 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-353f0da0-3e7a-40b4-8269-42d939409b74 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:32.106216 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-353f0da0-3e7a-40b4-8269-42d939409b74 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.352127 Aug 07 22:38:32.108991 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 80/154] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:31 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:38:32.501349 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-50f34375-acb0-4e6a-99d7-a6884b3bc5a3 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "POST /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.473516 Aug 07 22:38:32.502155 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 75/155] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 22:38:26 2022] POST /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7/os-volume_attachments => generated 194 bytes in 6475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:38:33.130123 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-4f1a237e-1277-414b-b8f3-6596030b217f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:33.130808 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-4f1a237e-1277-414b-b8f3-6596030b217f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:33.138655 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4f1a237e-1277-414b-b8f3-6596030b217f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:33.139170 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4f1a237e-1277-414b-b8f3-6596030b217f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:33.139825 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4f1a237e-1277-414b-b8f3-6596030b217f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:33.140675 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4f1a237e-1277-414b-b8f3-6596030b217f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:33.141157 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4f1a237e-1277-414b-b8f3-6596030b217f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:33.141694 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4f1a237e-1277-414b-b8f3-6596030b217f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:33.288707 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-4f1a237e-1277-414b-b8f3-6596030b217f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:33.296528 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-4f1a237e-1277-414b-b8f3-6596030b217f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.170506 Aug 07 22:38:33.297094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 81/156] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:33 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:34.319498 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ac2739a0-2f59-4a85-8237-52f263910a26 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:34.320273 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-ac2739a0-2f59-4a85-8237-52f263910a26 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:34.322332 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=62 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:38:34.329008 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ac2739a0-2f59-4a85-8237-52f263910a26 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:34.329008 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ac2739a0-2f59-4a85-8237-52f263910a26 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:34.329008 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ac2739a0-2f59-4a85-8237-52f263910a26 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:34.329310 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ac2739a0-2f59-4a85-8237-52f263910a26 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:34.330090 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ac2739a0-2f59-4a85-8237-52f263910a26 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:34.330514 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ac2739a0-2f59-4a85-8237-52f263910a26 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:34.477219 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-ac2739a0-2f59-4a85-8237-52f263910a26 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:34.484687 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-ac2739a0-2f59-4a85-8237-52f263910a26 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.169937 Aug 07 22:38:34.485664 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 76/157] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:34 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:35.505863 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f0541f4e-5230-4b22-8b6b-fa9b94dd9a36 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:35.506462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f0541f4e-5230-4b22-8b6b-fa9b94dd9a36 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:35.513300 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f0541f4e-5230-4b22-8b6b-fa9b94dd9a36 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:35.513770 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f0541f4e-5230-4b22-8b6b-fa9b94dd9a36 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:35.514201 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f0541f4e-5230-4b22-8b6b-fa9b94dd9a36 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:35.514869 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f0541f4e-5230-4b22-8b6b-fa9b94dd9a36 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:35.515310 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f0541f4e-5230-4b22-8b6b-fa9b94dd9a36 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:35.515729 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f0541f4e-5230-4b22-8b6b-fa9b94dd9a36 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:35.640803 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f0541f4e-5230-4b22-8b6b-fa9b94dd9a36 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:35.648212 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f0541f4e-5230-4b22-8b6b-fa9b94dd9a36 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.146178 Aug 07 22:38:35.648795 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 82/158] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:35 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:38:36.669000 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-38c69502-7099-4c37-b846-c076a39d3005 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:36.669608 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-38c69502-7099-4c37-b846-c076a39d3005 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:36.675913 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-38c69502-7099-4c37-b846-c076a39d3005 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:36.676411 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-38c69502-7099-4c37-b846-c076a39d3005 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:36.676870 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-38c69502-7099-4c37-b846-c076a39d3005 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:36.677541 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-38c69502-7099-4c37-b846-c076a39d3005 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:36.677984 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-38c69502-7099-4c37-b846-c076a39d3005 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:36.678397 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-38c69502-7099-4c37-b846-c076a39d3005 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:36.813960 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-38c69502-7099-4c37-b846-c076a39d3005 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:36.822181 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-38c69502-7099-4c37-b846-c076a39d3005 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.156993 Aug 07 22:38:36.822923 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 77/159] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:36 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:37.842292 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-ac2a6011-ffa1-488a-be42-42561a21af37 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:37.842901 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-ac2a6011-ffa1-488a-be42-42561a21af37 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:37.848743 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ac2a6011-ffa1-488a-be42-42561a21af37 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:37.849216 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ac2a6011-ffa1-488a-be42-42561a21af37 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:37.849652 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ac2a6011-ffa1-488a-be42-42561a21af37 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:37.850343 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ac2a6011-ffa1-488a-be42-42561a21af37 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:37.850856 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ac2a6011-ffa1-488a-be42-42561a21af37 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:37.851893 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ac2a6011-ffa1-488a-be42-42561a21af37 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:37.983195 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-ac2a6011-ffa1-488a-be42-42561a21af37 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:37.991163 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-ac2a6011-ffa1-488a-be42-42561a21af37 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.152716 Aug 07 22:38:37.991738 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 83/160] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:37 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:39.012347 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7b46b692-1438-471e-b62c-146bc8b63dbb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:39.012981 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-7b46b692-1438-471e-b62c-146bc8b63dbb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:39.019535 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7b46b692-1438-471e-b62c-146bc8b63dbb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:39.020027 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7b46b692-1438-471e-b62c-146bc8b63dbb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:39.020501 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7b46b692-1438-471e-b62c-146bc8b63dbb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:39.021184 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7b46b692-1438-471e-b62c-146bc8b63dbb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:39.021666 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7b46b692-1438-471e-b62c-146bc8b63dbb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:39.022101 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7b46b692-1438-471e-b62c-146bc8b63dbb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:39.161389 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7b46b692-1438-471e-b62c-146bc8b63dbb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:39.169263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-7b46b692-1438-471e-b62c-146bc8b63dbb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.160735 Aug 07 22:38:39.169840 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 78/161] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:39 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:40.191236 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-847d8a0d-aacc-4130-a7e0-0d210b5b396e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:40.191977 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-847d8a0d-aacc-4130-a7e0-0d210b5b396e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:40.201103 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-847d8a0d-aacc-4130-a7e0-0d210b5b396e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:40.201690 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-847d8a0d-aacc-4130-a7e0-0d210b5b396e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:40.202138 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-847d8a0d-aacc-4130-a7e0-0d210b5b396e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:40.202855 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-847d8a0d-aacc-4130-a7e0-0d210b5b396e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:40.203303 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-847d8a0d-aacc-4130-a7e0-0d210b5b396e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:40.203718 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-847d8a0d-aacc-4130-a7e0-0d210b5b396e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:40.331677 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-847d8a0d-aacc-4130-a7e0-0d210b5b396e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:40.340114 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-847d8a0d-aacc-4130-a7e0-0d210b5b396e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.153467 Aug 07 22:38:40.340690 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 84/162] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:40 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:41.363910 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-316687d7-a916-4eb2-8acd-ecc09287e475 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:41.363910 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-316687d7-a916-4eb2-8acd-ecc09287e475 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:41.371539 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-316687d7-a916-4eb2-8acd-ecc09287e475 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:41.391015 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-316687d7-a916-4eb2-8acd-ecc09287e475 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:41.391015 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-316687d7-a916-4eb2-8acd-ecc09287e475 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:41.391015 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-316687d7-a916-4eb2-8acd-ecc09287e475 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:41.391015 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-316687d7-a916-4eb2-8acd-ecc09287e475 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:41.391394 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-316687d7-a916-4eb2-8acd-ecc09287e475 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:41.504043 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-316687d7-a916-4eb2-8acd-ecc09287e475 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:41.511818 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-316687d7-a916-4eb2-8acd-ecc09287e475 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.152575 Aug 07 22:38:41.512412 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 79/163] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:41 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:42.532006 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-80f58025-ff83-4715-8116-43cd63d6a2be tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:42.532659 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-80f58025-ff83-4715-8116-43cd63d6a2be tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:42.538666 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-80f58025-ff83-4715-8116-43cd63d6a2be tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:42.539146 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-80f58025-ff83-4715-8116-43cd63d6a2be tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:42.539580 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-80f58025-ff83-4715-8116-43cd63d6a2be tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:42.540289 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-80f58025-ff83-4715-8116-43cd63d6a2be tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:42.540741 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-80f58025-ff83-4715-8116-43cd63d6a2be tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:42.541160 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-80f58025-ff83-4715-8116-43cd63d6a2be tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:42.689036 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-80f58025-ff83-4715-8116-43cd63d6a2be tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:42.697447 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-80f58025-ff83-4715-8116-43cd63d6a2be tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.169236 Aug 07 22:38:42.701246 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 85/164] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:42 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:43.718774 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d1a7ed44-08af-4917-b38d-63e7069a009d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:43.719306 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-d1a7ed44-08af-4917-b38d-63e7069a009d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:43.726292 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d1a7ed44-08af-4917-b38d-63e7069a009d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:43.726793 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d1a7ed44-08af-4917-b38d-63e7069a009d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:43.727260 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d1a7ed44-08af-4917-b38d-63e7069a009d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:43.727924 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d1a7ed44-08af-4917-b38d-63e7069a009d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:43.728390 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d1a7ed44-08af-4917-b38d-63e7069a009d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:43.728805 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d1a7ed44-08af-4917-b38d-63e7069a009d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:43.854909 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-d1a7ed44-08af-4917-b38d-63e7069a009d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:43.862719 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-d1a7ed44-08af-4917-b38d-63e7069a009d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.147897 Aug 07 22:38:43.863284 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 80/165] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:43 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:44.884276 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-63261471-a744-46f7-bddc-db0855aeea78 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:44.885473 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-63261471-a744-46f7-bddc-db0855aeea78 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:44.891319 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-63261471-a744-46f7-bddc-db0855aeea78 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:44.906685 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-63261471-a744-46f7-bddc-db0855aeea78 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:44.906685 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-63261471-a744-46f7-bddc-db0855aeea78 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:44.906685 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-63261471-a744-46f7-bddc-db0855aeea78 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:44.906685 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-63261471-a744-46f7-bddc-db0855aeea78 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:44.907053 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-63261471-a744-46f7-bddc-db0855aeea78 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:45.026168 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-63261471-a744-46f7-bddc-db0855aeea78 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:45.033847 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-63261471-a744-46f7-bddc-db0855aeea78 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.154506 Aug 07 22:38:45.034410 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 86/166] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:44 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:46.056191 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-28fe10db-4451-4607-9e6a-3dd7694ac30e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:46.056747 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-28fe10db-4451-4607-9e6a-3dd7694ac30e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:46.063154 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-28fe10db-4451-4607-9e6a-3dd7694ac30e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:46.063629 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-28fe10db-4451-4607-9e6a-3dd7694ac30e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:46.064081 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-28fe10db-4451-4607-9e6a-3dd7694ac30e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:46.064766 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-28fe10db-4451-4607-9e6a-3dd7694ac30e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:46.065210 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-28fe10db-4451-4607-9e6a-3dd7694ac30e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:46.065628 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-28fe10db-4451-4607-9e6a-3dd7694ac30e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:46.192912 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-28fe10db-4451-4607-9e6a-3dd7694ac30e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:46.200951 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-28fe10db-4451-4607-9e6a-3dd7694ac30e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.149511 Aug 07 22:38:46.201526 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 81/167] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:46 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:47.222334 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-1e1e2884-5395-4c2c-b6d9-27fc38a144e8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:47.223213 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-1e1e2884-5395-4c2c-b6d9-27fc38a144e8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:47.229349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1e1e2884-5395-4c2c-b6d9-27fc38a144e8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:47.229803 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1e1e2884-5395-4c2c-b6d9-27fc38a144e8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:47.230232 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1e1e2884-5395-4c2c-b6d9-27fc38a144e8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:47.230911 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1e1e2884-5395-4c2c-b6d9-27fc38a144e8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:47.231361 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1e1e2884-5395-4c2c-b6d9-27fc38a144e8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:47.231780 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1e1e2884-5395-4c2c-b6d9-27fc38a144e8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:47.236071 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=100 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:38:47.359950 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-1e1e2884-5395-4c2c-b6d9-27fc38a144e8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:47.368184 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-1e1e2884-5395-4c2c-b6d9-27fc38a144e8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.149666 Aug 07 22:38:47.368749 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 87/168] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:47 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:48.389617 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-2004bdf3-ac4b-4530-ab7f-86f8b3925e4f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:48.390271 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-2004bdf3-ac4b-4530-ab7f-86f8b3925e4f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:48.396694 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2004bdf3-ac4b-4530-ab7f-86f8b3925e4f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:48.397173 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2004bdf3-ac4b-4530-ab7f-86f8b3925e4f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:48.397603 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2004bdf3-ac4b-4530-ab7f-86f8b3925e4f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:48.398947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2004bdf3-ac4b-4530-ab7f-86f8b3925e4f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:48.398947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2004bdf3-ac4b-4530-ab7f-86f8b3925e4f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:48.399206 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2004bdf3-ac4b-4530-ab7f-86f8b3925e4f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:48.538944 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-2004bdf3-ac4b-4530-ab7f-86f8b3925e4f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:48.548826 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-2004bdf3-ac4b-4530-ab7f-86f8b3925e4f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.163135 Aug 07 22:38:48.549366 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 82/169] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:48 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:38:48.754801 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f5aaf5d0-1e54-4678-919e-01487085ac46 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:48.755352 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f5aaf5d0-1e54-4678-919e-01487085ac46 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:48.762497 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f5aaf5d0-1e54-4678-919e-01487085ac46 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:48.762988 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f5aaf5d0-1e54-4678-919e-01487085ac46 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:48.763468 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f5aaf5d0-1e54-4678-919e-01487085ac46 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:48.764194 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f5aaf5d0-1e54-4678-919e-01487085ac46 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:48.764693 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f5aaf5d0-1e54-4678-919e-01487085ac46 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:48.765126 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f5aaf5d0-1e54-4678-919e-01487085ac46 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:48.792717 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f5aaf5d0-1e54-4678-919e-01487085ac46 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Going to try to terminate instance {{(pid=129964) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 22:38:49.084582 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f5aaf5d0-1e54-4678-919e-01487085ac46 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 204 len: 0 microversion: 2.1 time: 0.333338 Aug 07 22:38:49.085194 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 88/170] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:38:48 2022] DELETE /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 22:38:49.093492 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-1c307053-0254-4b07-ae64-530068864e09 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:49.094083 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-1c307053-0254-4b07-ae64-530068864e09 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:49.100187 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1c307053-0254-4b07-ae64-530068864e09 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:49.100674 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1c307053-0254-4b07-ae64-530068864e09 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:49.101095 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1c307053-0254-4b07-ae64-530068864e09 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:49.101813 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1c307053-0254-4b07-ae64-530068864e09 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:49.102487 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1c307053-0254-4b07-ae64-530068864e09 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:49.102989 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1c307053-0254-4b07-ae64-530068864e09 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:49.238252 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-1c307053-0254-4b07-ae64-530068864e09 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:49.246956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-1c307053-0254-4b07-ae64-530068864e09 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1552 microversion: 2.1 time: 0.157432 Aug 07 22:38:49.247553 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 83/171] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:49 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:38:49.572637 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-ba24f1a0-5e8e-45f6-9277-02f82f8aa6f0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:49.573334 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-ba24f1a0-5e8e-45f6-9277-02f82f8aa6f0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:49.579312 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ba24f1a0-5e8e-45f6-9277-02f82f8aa6f0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:49.579792 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ba24f1a0-5e8e-45f6-9277-02f82f8aa6f0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:49.580281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ba24f1a0-5e8e-45f6-9277-02f82f8aa6f0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:49.580949 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ba24f1a0-5e8e-45f6-9277-02f82f8aa6f0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:49.581400 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ba24f1a0-5e8e-45f6-9277-02f82f8aa6f0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:49.581817 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ba24f1a0-5e8e-45f6-9277-02f82f8aa6f0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:49.731375 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-ba24f1a0-5e8e-45f6-9277-02f82f8aa6f0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:49.739232 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-ba24f1a0-5e8e-45f6-9277-02f82f8aa6f0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.170979 Aug 07 22:38:49.740100 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 89/172] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:49 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:50.268008 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-f61d67a8-17f9-4621-b38d-32b4f2f9e3d6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:50.268833 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-f61d67a8-17f9-4621-b38d-32b4f2f9e3d6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:50.275474 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f61d67a8-17f9-4621-b38d-32b4f2f9e3d6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:50.276114 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f61d67a8-17f9-4621-b38d-32b4f2f9e3d6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:50.276565 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f61d67a8-17f9-4621-b38d-32b4f2f9e3d6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:50.277269 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f61d67a8-17f9-4621-b38d-32b4f2f9e3d6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:50.277820 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f61d67a8-17f9-4621-b38d-32b4f2f9e3d6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:50.278248 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f61d67a8-17f9-4621-b38d-32b4f2f9e3d6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:50.420265 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f61d67a8-17f9-4621-b38d-32b4f2f9e3d6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:50.428171 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-f61d67a8-17f9-4621-b38d-32b4f2f9e3d6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1552 microversion: 2.1 time: 0.164204 Aug 07 22:38:50.428736 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 84/173] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:50 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:50.760296 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-8d81e3bc-76a2-4aef-b2bf-de91eac8c515 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:50.760901 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-8d81e3bc-76a2-4aef-b2bf-de91eac8c515 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:50.766717 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8d81e3bc-76a2-4aef-b2bf-de91eac8c515 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:50.767192 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8d81e3bc-76a2-4aef-b2bf-de91eac8c515 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:50.767632 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8d81e3bc-76a2-4aef-b2bf-de91eac8c515 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:50.768338 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8d81e3bc-76a2-4aef-b2bf-de91eac8c515 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:50.768788 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8d81e3bc-76a2-4aef-b2bf-de91eac8c515 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:50.769212 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8d81e3bc-76a2-4aef-b2bf-de91eac8c515 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:50.901953 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-8d81e3bc-76a2-4aef-b2bf-de91eac8c515 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:50.912236 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-8d81e3bc-76a2-4aef-b2bf-de91eac8c515 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.156500 Aug 07 22:38:50.912971 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 90/174] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:50 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:51.450390 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-1d959b87-fd03-4bcc-86b7-9b437bd98259 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:51.450897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-1d959b87-fd03-4bcc-86b7-9b437bd98259 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:51.456786 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1d959b87-fd03-4bcc-86b7-9b437bd98259 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:51.457259 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1d959b87-fd03-4bcc-86b7-9b437bd98259 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:51.457693 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1d959b87-fd03-4bcc-86b7-9b437bd98259 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:51.458369 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1d959b87-fd03-4bcc-86b7-9b437bd98259 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:51.458831 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1d959b87-fd03-4bcc-86b7-9b437bd98259 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:51.459240 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1d959b87-fd03-4bcc-86b7-9b437bd98259 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:51.609995 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-1d959b87-fd03-4bcc-86b7-9b437bd98259 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:51.619141 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-1d959b87-fd03-4bcc-86b7-9b437bd98259 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1552 microversion: 2.1 time: 0.173933 Aug 07 22:38:51.619714 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 85/175] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:51 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1552 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:51.933671 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-00fb08b5-83d4-407c-b147-f12877c5bd78 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:51.934274 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-00fb08b5-83d4-407c-b147-f12877c5bd78 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:51.940636 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-00fb08b5-83d4-407c-b147-f12877c5bd78 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:51.941119 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-00fb08b5-83d4-407c-b147-f12877c5bd78 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:51.941583 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-00fb08b5-83d4-407c-b147-f12877c5bd78 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:51.942354 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-00fb08b5-83d4-407c-b147-f12877c5bd78 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:51.943207 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-00fb08b5-83d4-407c-b147-f12877c5bd78 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:51.943302 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-00fb08b5-83d4-407c-b147-f12877c5bd78 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:52.082151 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-00fb08b5-83d4-407c-b147-f12877c5bd78 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:52.090304 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-00fb08b5-83d4-407c-b147-f12877c5bd78 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.160834 Aug 07 22:38:52.091240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 91/176] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:51 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:52.640128 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-f1b74512-349d-4f64-ad5c-a00084f07f85 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:52.640738 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-f1b74512-349d-4f64-ad5c-a00084f07f85 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:52.647011 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f1b74512-349d-4f64-ad5c-a00084f07f85 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:52.647488 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f1b74512-349d-4f64-ad5c-a00084f07f85 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:52.647919 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f1b74512-349d-4f64-ad5c-a00084f07f85 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:52.649379 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f1b74512-349d-4f64-ad5c-a00084f07f85 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:52.649833 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f1b74512-349d-4f64-ad5c-a00084f07f85 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:52.650256 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f1b74512-349d-4f64-ad5c-a00084f07f85 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:52.654124 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:38:52.782669 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f1b74512-349d-4f64-ad5c-a00084f07f85 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:52.791137 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-f1b74512-349d-4f64-ad5c-a00084f07f85 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1552 microversion: 2.1 time: 0.154851 Aug 07 22:38:52.791717 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 86/177] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:52 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:53.113034 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-002d3969-fa99-4253-afc6-aff6b365c043 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:53.113661 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-002d3969-fa99-4253-afc6-aff6b365c043 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:53.119672 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-002d3969-fa99-4253-afc6-aff6b365c043 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:53.120175 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-002d3969-fa99-4253-afc6-aff6b365c043 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:53.120601 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-002d3969-fa99-4253-afc6-aff6b365c043 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:53.121272 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-002d3969-fa99-4253-afc6-aff6b365c043 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:53.121759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-002d3969-fa99-4253-afc6-aff6b365c043 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:53.122168 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-002d3969-fa99-4253-afc6-aff6b365c043 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:53.255265 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-002d3969-fa99-4253-afc6-aff6b365c043 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:53.264718 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-002d3969-fa99-4253-afc6-aff6b365c043 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.155551 Aug 07 22:38:53.265501 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 92/178] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:53 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:53.813500 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-8c3aa4a4-293d-478b-a486-47a1b96f9537 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:53.814103 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-8c3aa4a4-293d-478b-a486-47a1b96f9537 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:53.820962 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8c3aa4a4-293d-478b-a486-47a1b96f9537 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:53.821434 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8c3aa4a4-293d-478b-a486-47a1b96f9537 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:53.821866 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8c3aa4a4-293d-478b-a486-47a1b96f9537 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:53.822544 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8c3aa4a4-293d-478b-a486-47a1b96f9537 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:53.822990 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8c3aa4a4-293d-478b-a486-47a1b96f9537 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:53.823406 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8c3aa4a4-293d-478b-a486-47a1b96f9537 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:53.983241 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8c3aa4a4-293d-478b-a486-47a1b96f9537 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:54.002410 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-8c3aa4a4-293d-478b-a486-47a1b96f9537 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1552 microversion: 2.1 time: 0.192935 Aug 07 22:38:54.003114 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 87/179] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:53 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1552 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:54.286956 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-da3f9db8-39c6-42ad-b705-c13dbc75de5d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:54.287638 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-da3f9db8-39c6-42ad-b705-c13dbc75de5d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:54.294553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-da3f9db8-39c6-42ad-b705-c13dbc75de5d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:54.295033 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-da3f9db8-39c6-42ad-b705-c13dbc75de5d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:54.296591 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-da3f9db8-39c6-42ad-b705-c13dbc75de5d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:54.297486 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-da3f9db8-39c6-42ad-b705-c13dbc75de5d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:54.297953 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-da3f9db8-39c6-42ad-b705-c13dbc75de5d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:54.298579 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-da3f9db8-39c6-42ad-b705-c13dbc75de5d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:54.529693 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-da3f9db8-39c6-42ad-b705-c13dbc75de5d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:54.539325 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-da3f9db8-39c6-42ad-b705-c13dbc75de5d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.255888 Aug 07 22:38:54.540124 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 93/180] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:54 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:55.023956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-34ccf5c8-c098-4edf-aa65-eaa68b6e5734 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:55.024768 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-34ccf5c8-c098-4edf-aa65-eaa68b6e5734 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:55.032711 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-34ccf5c8-c098-4edf-aa65-eaa68b6e5734 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:55.033186 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-34ccf5c8-c098-4edf-aa65-eaa68b6e5734 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:55.033616 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-34ccf5c8-c098-4edf-aa65-eaa68b6e5734 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:55.034303 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-34ccf5c8-c098-4edf-aa65-eaa68b6e5734 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:55.034746 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-34ccf5c8-c098-4edf-aa65-eaa68b6e5734 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:55.035161 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-34ccf5c8-c098-4edf-aa65-eaa68b6e5734 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:55.327078 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-34ccf5c8-c098-4edf-aa65-eaa68b6e5734 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:55.335884 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-34ccf5c8-c098-4edf-aa65-eaa68b6e5734 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1552 microversion: 2.1 time: 0.315819 Aug 07 22:38:55.340161 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 88/181] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:55 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1552 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:55.544221 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-15b33789-f904-447d-b6ee-49dc1d0f6287 req-40fd9e71-1565-416c-9a08-3754301d7d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e2c1f8-3d85-437e-9c51-805820cfa4a7", "name": "network-vif-deleted", "tag": "ee8dc2da-5ffd-43e1-a446-69c9b4634a95"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:38:55.560801 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-15b33789-f904-447d-b6ee-49dc1d0f6287 req-40fd9e71-1565-416c-9a08-3754301d7d42 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:55.561268 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-15b33789-f904-447d-b6ee-49dc1d0f6287 req-40fd9e71-1565-416c-9a08-3754301d7d42 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:55.561704 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-c80d4305-99c9-45a8-b47e-e7daabf6223c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:55.561870 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-15b33789-f904-447d-b6ee-49dc1d0f6287 req-40fd9e71-1565-416c-9a08-3754301d7d42 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:55.562518 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-c80d4305-99c9-45a8-b47e-e7daabf6223c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:55.569733 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c80d4305-99c9-45a8-b47e-e7daabf6223c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:55.570565 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c80d4305-99c9-45a8-b47e-e7daabf6223c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:55.570998 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c80d4305-99c9-45a8-b47e-e7daabf6223c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:55.571867 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c80d4305-99c9-45a8-b47e-e7daabf6223c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:55.572650 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c80d4305-99c9-45a8-b47e-e7daabf6223c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:55.573142 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c80d4305-99c9-45a8-b47e-e7daabf6223c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:55.576607 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-15b33789-f904-447d-b6ee-49dc1d0f6287 req-40fd9e71-1565-416c-9a08-3754301d7d42 service nova] Creating event network-vif-deleted:ee8dc2da-5ffd-43e1-a446-69c9b4634a95 for instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 on hv-cinder-85032 Aug 07 22:38:55.585147 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-15b33789-f904-447d-b6ee-49dc1d0f6287 req-40fd9e71-1565-416c-9a08-3754301d7d42 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044267 Aug 07 22:38:55.586871 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 94/182] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:38:55.751320 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-c80d4305-99c9-45a8-b47e-e7daabf6223c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:55.759223 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-c80d4305-99c9-45a8-b47e-e7daabf6223c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1521 microversion: 2.1 time: 0.201587 Aug 07 22:38:55.759811 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 89/183] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:55 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:56.359820 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-7385dc06-f863-4839-bee8-040ef8c9a83c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:56.363450 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-7385dc06-f863-4839-bee8-040ef8c9a83c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:56.371024 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7385dc06-f863-4839-bee8-040ef8c9a83c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:56.371514 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7385dc06-f863-4839-bee8-040ef8c9a83c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:56.371948 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7385dc06-f863-4839-bee8-040ef8c9a83c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:56.372675 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7385dc06-f863-4839-bee8-040ef8c9a83c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:56.373154 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7385dc06-f863-4839-bee8-040ef8c9a83c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:56.373579 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7385dc06-f863-4839-bee8-040ef8c9a83c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:56.408988 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7385dc06-f863-4839-bee8-040ef8c9a83c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:56.409473 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7385dc06-f863-4839-bee8-040ef8c9a83c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:56.410084 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7385dc06-f863-4839-bee8-040ef8c9a83c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:56.410755 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.objects.instance [None req-7385dc06-f863-4839-bee8-040ef8c9a83c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lazy-loading 'fault' on Instance uuid c9e2c1f8-3d85-437e-9c51-805820cfa4a7 {{(pid=129964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:38:56.458915 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-7385dc06-f863-4839-bee8-040ef8c9a83c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd02222f0b14a588b51a792b02ca852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd3d94550bd467f8a88d75ec1208be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:56.468111 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-7385dc06-f863-4839-bee8-040ef8c9a83c tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 200 len: 1350 microversion: 2.1 time: 0.112594 Aug 07 22:38:56.468599 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 95/184] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:56 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 1350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:56.780305 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-cdcbbffe-a344-40e2-9263-c254208b8787 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:56.780924 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-cdcbbffe-a344-40e2-9263-c254208b8787 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:56.786897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cdcbbffe-a344-40e2-9263-c254208b8787 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:56.787350 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cdcbbffe-a344-40e2-9263-c254208b8787 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:56.790997 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cdcbbffe-a344-40e2-9263-c254208b8787 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:56.790997 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cdcbbffe-a344-40e2-9263-c254208b8787 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:56.790997 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cdcbbffe-a344-40e2-9263-c254208b8787 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:56.790997 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cdcbbffe-a344-40e2-9263-c254208b8787 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:56.948226 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-cdcbbffe-a344-40e2-9263-c254208b8787 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:56.956930 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-cdcbbffe-a344-40e2-9263-c254208b8787 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1501 microversion: 2.1 time: 0.180599 Aug 07 22:38:56.968876 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 90/185] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:56 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1501 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:56.987308 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-d0e9747c-d25a-4bbc-9e68-7be0ce7463c3 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:56.989122 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-d0e9747c-d25a-4bbc-9e68-7be0ce7463c3 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:56.996000 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d0e9747c-d25a-4bbc-9e68-7be0ce7463c3 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:56.996907 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d0e9747c-d25a-4bbc-9e68-7be0ce7463c3 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:56.997590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d0e9747c-d25a-4bbc-9e68-7be0ce7463c3 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:56.998522 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d0e9747c-d25a-4bbc-9e68-7be0ce7463c3 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:56.999215 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d0e9747c-d25a-4bbc-9e68-7be0ce7463c3 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:56.999835 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d0e9747c-d25a-4bbc-9e68-7be0ce7463c3 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:57.148719 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-d0e9747c-d25a-4bbc-9e68-7be0ce7463c3 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:57.157767 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-d0e9747c-d25a-4bbc-9e68-7be0ce7463c3 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1515 microversion: 2.1 time: 0.182317 Aug 07 22:38:57.158364 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 96/186] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:56 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:38:57.490737 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-508c15ce-8609-4485-a875-7dcb71940af8 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:57.491255 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-508c15ce-8609-4485-a875-7dcb71940af8 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:57.497744 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-508c15ce-8609-4485-a875-7dcb71940af8 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:57.498281 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-508c15ce-8609-4485-a875-7dcb71940af8 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:57.498715 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-508c15ce-8609-4485-a875-7dcb71940af8 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:57.499441 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-508c15ce-8609-4485-a875-7dcb71940af8 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:57.499896 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-508c15ce-8609-4485-a875-7dcb71940af8 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:57.500340 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-508c15ce-8609-4485-a875-7dcb71940af8 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:57.515604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.wsgi [None req-508c15ce-8609-4485-a875-7dcb71940af8 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] HTTP exception thrown: Instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 could not be found. Aug 07 22:38:57.520220 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-508c15ce-8609-4485-a875-7dcb71940af8 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Request method failure captured: Aug 07 22:38:57.520220 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: request: GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 HTTP/1.1 Aug 07 22:38:57.520220 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept: application/json Aug 07 22:38:57.520220 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept-Encoding: identity Aug 07 22:38:57.520220 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Connection: close Aug 07 22:38:57.520220 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Length: 0 Aug 07 22:38:57.520220 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Type: application/json Aug 07 22:38:57.520220 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Host: 10.222.0.30 Aug 07 22:38:57.520220 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Openstack-System-Scope: None Aug 07 22:38:57.520220 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: User-Agent: python-urllib3/1.26.11 Aug 07 22:38:57.520220 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Auth-Token: gAAAAABi8D6rg9hSxEJUNpak3NGT8lO1E7MSk1MdTaYaC7zoK7mA46nGHYOlyQchPc6XLy5ZsLNtG4y2etiVaUoVo6nCLI-C-C0x5Q1e-YyeW4GnO8dlybWNVQjn-FnHH5w4xhhU603QH8OE25UElH6ooW330KR6eO4l8OR1iRFrS-Y-JGZBIrQ Aug 07 22:38:57.520220 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Id: None Aug 07 22:38:57.520220 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Name: None Aug 07 22:38:57.520220 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Identity-Status: Confirmed Aug 07 22:38:57.520220 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Is-Admin-Project: True Aug 07 22:38:57.520220 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Id: default Aug 07 22:38:57.520220 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Name: Default Aug 07 22:38:57.520220 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Id: 6cd3d94550bd467f8a88d75ec1208be1 Aug 07 22:38:57.520220 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Name: tempest-DeleteServersTestJSON-1945517391 Aug 07 22:38:57.520220 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Role: reader,member Aug 07 22:38:57.520220 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Roles: reader,member Aug 07 22:38:57.521675 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6cd3d94550bd467f8a88d75ec1208be1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6cd3d94550bd467f8a88d75ec1208be1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6cd3d94550bd467f8a88d75ec1208be1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6cd3d94550bd467f8a88d75ec1208be1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:38:57.521675 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant: tempest-DeleteServersTestJSON-1945517391 Aug 07 22:38:57.521675 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Id: 6cd3d94550bd467f8a88d75ec1208be1 Aug 07 22:38:57.521675 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Name: tempest-DeleteServersTestJSON-1945517391 Aug 07 22:38:57.521675 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User: tempest-DeleteServersTestJSON-1945517391-project Aug 07 22:38:57.521675 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Id: default Aug 07 22:38:57.521675 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Name: Default Aug 07 22:38:57.521675 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Id: dfd02222f0b14a588b51a792b02ca852 Aug 07 22:38:57.521675 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Name: tempest-DeleteServersTestJSON-1945517391-project Aug 07 22:38:57.521675 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: method: > Aug 07 22:38:57.521675 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: exception: Instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 could not be found. Aug 07 22:38:57.521675 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: action_args: {'id': 'c9e2c1f8-3d85-437e-9c51-805820cfa4a7'} Aug 07 22:38:57.527051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:38:57.527051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:38:57.527051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:38:57.527051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:38:57.527051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:38:57.527051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:38:57.527051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:38:57.527051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:38:57.527051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:38:57.527051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:38:57.527051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 could not be found. Aug 07 22:38:57.527051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:38:57.527051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:38:57.527051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:38:57.527051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:38:57.527051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:38:57.527051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:38:57.527051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:38:57.527051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:38:57.527051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:38:57.529053 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:38:57.529053 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:38:57.529053 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:38:57.529053 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:38:57.529053 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:38:57.529053 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:38:57.529053 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:38:57.529053 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 could not be found. Aug 07 22:38:57.529053 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:38:57.529053 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:38:57.529053 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:38:57.529053 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:38:57.529053 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:38:57.529053 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:38:57.529053 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:38:57.529053 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:38:57.529053 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 could not be found. Aug 07 22:38:57.529053 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:38:57.530140 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-508c15ce-8609-4485-a875-7dcb71940af8 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Returning 404 to user: Instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 could not be found. {{(pid=129965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:38:57.530140 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-508c15ce-8609-4485-a875-7dcb71940af8 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 404 len: 111 microversion: 2.1 time: 0.034882 Aug 07 22:38:57.530140 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 91/187] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:57 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:38:57.659716 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b176d596-6811-4cf8-aa06-21244ed5d4a6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:57.661945 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-b176d596-6811-4cf8-aa06-21244ed5d4a6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:57.668871 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b176d596-6811-4cf8-aa06-21244ed5d4a6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:57.669400 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b176d596-6811-4cf8-aa06-21244ed5d4a6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:57.669880 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b176d596-6811-4cf8-aa06-21244ed5d4a6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:57.670707 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b176d596-6811-4cf8-aa06-21244ed5d4a6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:57.671107 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b176d596-6811-4cf8-aa06-21244ed5d4a6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:57.671756 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b176d596-6811-4cf8-aa06-21244ed5d4a6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:57.687845 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-b176d596-6811-4cf8-aa06-21244ed5d4a6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] HTTP exception thrown: Instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 could not be found. Aug 07 22:38:57.691565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b176d596-6811-4cf8-aa06-21244ed5d4a6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Request method failure captured: Aug 07 22:38:57.691565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7/os-volume_attachments HTTP/1.1 Aug 07 22:38:57.691565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:38:57.691565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:38:57.691565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:38:57.691565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:38:57.691565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:38:57.691565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:38:57.691565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:38:57.691565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:38:57.691565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8D6rg9hSxEJUNpak3NGT8lO1E7MSk1MdTaYaC7zoK7mA46nGHYOlyQchPc6XLy5ZsLNtG4y2etiVaUoVo6nCLI-C-C0x5Q1e-YyeW4GnO8dlybWNVQjn-FnHH5w4xhhU603QH8OE25UElH6ooW330KR6eO4l8OR1iRFrS-Y-JGZBIrQ Aug 07 22:38:57.691565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:38:57.691565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:38:57.691565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:38:57.691565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:38:57.691565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:38:57.691565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:38:57.691565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 6cd3d94550bd467f8a88d75ec1208be1 Aug 07 22:38:57.691565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-DeleteServersTestJSON-1945517391 Aug 07 22:38:57.691565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:38:57.691565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:38:57.693024 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6cd3d94550bd467f8a88d75ec1208be1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6cd3d94550bd467f8a88d75ec1208be1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6cd3d94550bd467f8a88d75ec1208be1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6cd3d94550bd467f8a88d75ec1208be1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:38:57.693024 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-DeleteServersTestJSON-1945517391 Aug 07 22:38:57.693024 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 6cd3d94550bd467f8a88d75ec1208be1 Aug 07 22:38:57.693024 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-DeleteServersTestJSON-1945517391 Aug 07 22:38:57.693024 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-DeleteServersTestJSON-1945517391-project Aug 07 22:38:57.693024 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:38:57.693024 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:38:57.693024 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: dfd02222f0b14a588b51a792b02ca852 Aug 07 22:38:57.693024 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-DeleteServersTestJSON-1945517391-project Aug 07 22:38:57.693024 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: > Aug 07 22:38:57.693024 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 could not be found. Aug 07 22:38:57.693024 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'server_id': 'c9e2c1f8-3d85-437e-9c51-805820cfa4a7'} Aug 07 22:38:57.693798 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:38:57.693798 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:38:57.693798 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:38:57.693798 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:38:57.693798 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:38:57.693798 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:38:57.693798 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:38:57.693798 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:38:57.693798 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:38:57.693798 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:38:57.693798 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 could not be found. Aug 07 22:38:57.693798 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:38:57.693798 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:38:57.693798 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:38:57.693798 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:38:57.693798 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:38:57.693798 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:38:57.693798 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:38:57.693798 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:38:57.693798 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:38:57.695089 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:38:57.695089 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 22:38:57.695089 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 22:38:57.695089 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 22:38:57.695089 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 22:38:57.695089 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 07 22:38:57.695089 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 07 22:38:57.695089 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:38:57.695089 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:38:57.695089 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 could not be found. Aug 07 22:38:57.695089 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:38:57.695089 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:38:57.695089 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:38:57.695089 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:38:57.695089 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:38:57.695089 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:38:57.695089 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:38:57.695089 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:38:57.695089 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 could not be found. Aug 07 22:38:57.695089 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:38:57.697744 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b176d596-6811-4cf8-aa06-21244ed5d4a6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Returning 404 to user: Instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:38:57.698592 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-b176d596-6811-4cf8-aa06-21244ed5d4a6 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042945 Aug 07 22:38:57.699155 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 97/188] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 22:38:57 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:38:58.971869 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-36e8dc0c-3c4d-40b7-b588-3eaacbb38b1a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:38:58.983988 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-36e8dc0c-3c4d-40b7-b588-3eaacbb38b1a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:58.983988 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-36e8dc0c-3c4d-40b7-b588-3eaacbb38b1a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:58.983988 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-36e8dc0c-3c4d-40b7-b588-3eaacbb38b1a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:58.983988 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-36e8dc0c-3c4d-40b7-b588-3eaacbb38b1a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:58.984885 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-36e8dc0c-3c4d-40b7-b588-3eaacbb38b1a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:58.984885 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-36e8dc0c-3c4d-40b7-b588-3eaacbb38b1a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:58.984885 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-36e8dc0c-3c4d-40b7-b588-3eaacbb38b1a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:59.014319 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.objects.instance [None req-36e8dc0c-3c4d-40b7-b588-3eaacbb38b1a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lazy-loading 'flavor' on Instance uuid c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e {{(pid=129965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:38:59.087081 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-929f34ee-68b9-432b-b020-1154b88d6ddc tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:59.087760 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-929f34ee-68b9-432b-b020-1154b88d6ddc tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:59.094124 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-929f34ee-68b9-432b-b020-1154b88d6ddc tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:59.094686 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-929f34ee-68b9-432b-b020-1154b88d6ddc tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:59.095128 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-929f34ee-68b9-432b-b020-1154b88d6ddc tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:59.099114 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-929f34ee-68b9-432b-b020-1154b88d6ddc tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:59.099114 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-929f34ee-68b9-432b-b020-1154b88d6ddc tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:59.099114 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-929f34ee-68b9-432b-b020-1154b88d6ddc tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:59.115388 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-929f34ee-68b9-432b-b020-1154b88d6ddc tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] HTTP exception thrown: Instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 could not be found. Aug 07 22:38:59.117934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-929f34ee-68b9-432b-b020-1154b88d6ddc tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Request method failure captured: Aug 07 22:38:59.117934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: DELETE /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 HTTP/1.1 Aug 07 22:38:59.117934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:38:59.117934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:38:59.117934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:38:59.117934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:38:59.117934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:38:59.117934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:38:59.117934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:38:59.117934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:38:59.117934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8D6rg9hSxEJUNpak3NGT8lO1E7MSk1MdTaYaC7zoK7mA46nGHYOlyQchPc6XLy5ZsLNtG4y2etiVaUoVo6nCLI-C-C0x5Q1e-YyeW4GnO8dlybWNVQjn-FnHH5w4xhhU603QH8OE25UElH6ooW330KR6eO4l8OR1iRFrS-Y-JGZBIrQ Aug 07 22:38:59.117934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:38:59.117934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:38:59.117934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:38:59.117934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:38:59.117934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:38:59.117934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:38:59.117934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 6cd3d94550bd467f8a88d75ec1208be1 Aug 07 22:38:59.117934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-DeleteServersTestJSON-1945517391 Aug 07 22:38:59.117934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:38:59.117934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:38:59.119444 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6cd3d94550bd467f8a88d75ec1208be1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6cd3d94550bd467f8a88d75ec1208be1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6cd3d94550bd467f8a88d75ec1208be1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6cd3d94550bd467f8a88d75ec1208be1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:38:59.119444 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-DeleteServersTestJSON-1945517391 Aug 07 22:38:59.119444 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 6cd3d94550bd467f8a88d75ec1208be1 Aug 07 22:38:59.119444 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-DeleteServersTestJSON-1945517391 Aug 07 22:38:59.119444 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-DeleteServersTestJSON-1945517391-project Aug 07 22:38:59.119444 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:38:59.119444 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:38:59.119444 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: dfd02222f0b14a588b51a792b02ca852 Aug 07 22:38:59.119444 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-DeleteServersTestJSON-1945517391-project Aug 07 22:38:59.119444 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: > Aug 07 22:38:59.119444 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 could not be found. Aug 07 22:38:59.119444 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': 'c9e2c1f8-3d85-437e-9c51-805820cfa4a7'} Aug 07 22:38:59.120278 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:38:59.120278 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:38:59.120278 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:38:59.120278 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:38:59.120278 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:38:59.120278 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:38:59.120278 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:38:59.120278 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:38:59.120278 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:38:59.120278 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:38:59.120278 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 could not be found. Aug 07 22:38:59.120278 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:38:59.120278 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:38:59.120278 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:38:59.120278 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:38:59.120278 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:38:59.120278 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:38:59.120278 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:38:59.120278 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:38:59.120278 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:38:59.121637 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:38:59.121637 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 22:38:59.121637 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 22:38:59.121637 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 22:38:59.121637 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 22:38:59.121637 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:38:59.121637 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:38:59.121637 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:38:59.121637 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:38:59.121637 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 could not be found. Aug 07 22:38:59.121637 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:38:59.121637 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:38:59.121637 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:38:59.121637 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:38:59.121637 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:38:59.121637 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:38:59.121637 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:38:59.121637 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:38:59.121637 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 could not be found. Aug 07 22:38:59.121637 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:38:59.123124 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-929f34ee-68b9-432b-b020-1154b88d6ddc tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Returning 404 to user: Instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:38:59.123124 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-929f34ee-68b9-432b-b020-1154b88d6ddc tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 404 len: 111 microversion: 2.1 time: 0.036955 Aug 07 22:38:59.123124 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 98/189] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:38:59 2022] DELETE /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 22:38:59.135365 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a6621b2c-110d-4387-b310-e3f2153beb20 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:59.135985 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a6621b2c-110d-4387-b310-e3f2153beb20 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] [instance: c9e2c1f8-3d85-437e-9c51-805820cfa4a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:59.142128 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a6621b2c-110d-4387-b310-e3f2153beb20 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:59.142614 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a6621b2c-110d-4387-b310-e3f2153beb20 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:59.143053 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a6621b2c-110d-4387-b310-e3f2153beb20 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:59.143773 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a6621b2c-110d-4387-b310-e3f2153beb20 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:59.144392 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a6621b2c-110d-4387-b310-e3f2153beb20 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:59.144804 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a6621b2c-110d-4387-b310-e3f2153beb20 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:59.159578 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-a6621b2c-110d-4387-b310-e3f2153beb20 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] HTTP exception thrown: Instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 could not be found. Aug 07 22:38:59.161346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a6621b2c-110d-4387-b310-e3f2153beb20 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Request method failure captured: Aug 07 22:38:59.161346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 HTTP/1.1 Aug 07 22:38:59.161346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:38:59.161346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:38:59.161346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:38:59.161346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:38:59.161346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:38:59.161346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:38:59.161346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:38:59.161346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:38:59.161346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8D6rg9hSxEJUNpak3NGT8lO1E7MSk1MdTaYaC7zoK7mA46nGHYOlyQchPc6XLy5ZsLNtG4y2etiVaUoVo6nCLI-C-C0x5Q1e-YyeW4GnO8dlybWNVQjn-FnHH5w4xhhU603QH8OE25UElH6ooW330KR6eO4l8OR1iRFrS-Y-JGZBIrQ Aug 07 22:38:59.161346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:38:59.161346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:38:59.161346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:38:59.161346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:38:59.161346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:38:59.161346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:38:59.161346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 6cd3d94550bd467f8a88d75ec1208be1 Aug 07 22:38:59.161346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-DeleteServersTestJSON-1945517391 Aug 07 22:38:59.161346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:38:59.161346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:38:59.162955 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6cd3d94550bd467f8a88d75ec1208be1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6cd3d94550bd467f8a88d75ec1208be1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6cd3d94550bd467f8a88d75ec1208be1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6cd3d94550bd467f8a88d75ec1208be1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:38:59.162955 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-DeleteServersTestJSON-1945517391 Aug 07 22:38:59.162955 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 6cd3d94550bd467f8a88d75ec1208be1 Aug 07 22:38:59.162955 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-DeleteServersTestJSON-1945517391 Aug 07 22:38:59.162955 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-DeleteServersTestJSON-1945517391-project Aug 07 22:38:59.162955 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:38:59.162955 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:38:59.162955 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: dfd02222f0b14a588b51a792b02ca852 Aug 07 22:38:59.162955 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-DeleteServersTestJSON-1945517391-project Aug 07 22:38:59.162955 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: > Aug 07 22:38:59.162955 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 could not be found. Aug 07 22:38:59.162955 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': 'c9e2c1f8-3d85-437e-9c51-805820cfa4a7'} Aug 07 22:38:59.163626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:38:59.163626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:38:59.163626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:38:59.163626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:38:59.163626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:38:59.163626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:38:59.163626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:38:59.163626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:38:59.163626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:38:59.163626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:38:59.163626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 could not be found. Aug 07 22:38:59.163626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:38:59.163626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:38:59.163626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:38:59.163626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:38:59.163626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:38:59.163626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:38:59.163626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:38:59.163626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:38:59.163626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:38:59.165858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:38:59.165858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:38:59.165858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:38:59.165858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:38:59.165858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:38:59.165858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:38:59.165858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:38:59.165858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 could not be found. Aug 07 22:38:59.165858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:38:59.165858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:38:59.165858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:38:59.165858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:38:59.165858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:38:59.165858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:38:59.165858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:38:59.165858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:38:59.165858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 could not be found. Aug 07 22:38:59.165858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:38:59.167227 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a6621b2c-110d-4387-b310-e3f2153beb20 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] Returning 404 to user: Instance c9e2c1f8-3d85-437e-9c51-805820cfa4a7 could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:38:59.167227 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a6621b2c-110d-4387-b310-e3f2153beb20 tempest-DeleteServersTestJSON-1945517391 tempest-DeleteServersTestJSON-1945517391-project] 10.222.0.30 "GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7" status: 404 len: 111 microversion: 2.1 time: 0.032343 Aug 07 22:38:59.167227 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 99/190] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:59 2022] GET /compute/v2.1/servers/c9e2c1f8-3d85-437e-9c51-805820cfa4a7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 22:38:59.381381 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-36e8dc0c-3c4d-40b7-b588-3eaacbb38b1a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "POST /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e/action" status: 200 len: 32 microversion: 2.1 time: 0.412823 Aug 07 22:38:59.382712 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 92/191] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 22:38:58 2022] POST /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e/action => generated 32 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 22:38:59.394292 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-fd84bddc-c1f1-4073-9298-25f1064643cd tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:38:59.395210 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-fd84bddc-c1f1-4073-9298-25f1064643cd tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:38:59.402273 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:38:59.404322 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fd84bddc-c1f1-4073-9298-25f1064643cd tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:59.405073 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fd84bddc-c1f1-4073-9298-25f1064643cd tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:59.406110 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fd84bddc-c1f1-4073-9298-25f1064643cd tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:59.407041 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fd84bddc-c1f1-4073-9298-25f1064643cd tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:38:59.407606 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fd84bddc-c1f1-4073-9298-25f1064643cd tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:38:59.408679 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fd84bddc-c1f1-4073-9298-25f1064643cd tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:38:59.614844 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-fd84bddc-c1f1-4073-9298-25f1064643cd tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:38:59.626095 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-fd84bddc-c1f1-4073-9298-25f1064643cd tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.237324 Aug 07 22:38:59.627296 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 100/192] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:38:59 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:00.649239 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d2729ae1-b3e2-49de-88e3-b89878a2493b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:00.658518 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-d2729ae1-b3e2-49de-88e3-b89878a2493b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:00.658518 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d2729ae1-b3e2-49de-88e3-b89878a2493b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:00.658518 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d2729ae1-b3e2-49de-88e3-b89878a2493b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:00.659199 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d2729ae1-b3e2-49de-88e3-b89878a2493b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:00.659596 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d2729ae1-b3e2-49de-88e3-b89878a2493b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:00.660072 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d2729ae1-b3e2-49de-88e3-b89878a2493b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:00.660502 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d2729ae1-b3e2-49de-88e3-b89878a2493b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:00.886991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-d2729ae1-b3e2-49de-88e3-b89878a2493b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:00.895234 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-d2729ae1-b3e2-49de-88e3-b89878a2493b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.250454 Aug 07 22:39:00.895813 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 93/193] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:00 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:01.918954 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-3c0b3ba1-7364-484d-9baa-e09e0baf15d2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:01.920563 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-3c0b3ba1-7364-484d-9baa-e09e0baf15d2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:01.935642 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3c0b3ba1-7364-484d-9baa-e09e0baf15d2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:01.936558 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3c0b3ba1-7364-484d-9baa-e09e0baf15d2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:01.937255 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3c0b3ba1-7364-484d-9baa-e09e0baf15d2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:01.938279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3c0b3ba1-7364-484d-9baa-e09e0baf15d2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:01.939164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3c0b3ba1-7364-484d-9baa-e09e0baf15d2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:01.939783 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3c0b3ba1-7364-484d-9baa-e09e0baf15d2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:02.324079 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-3c0b3ba1-7364-484d-9baa-e09e0baf15d2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:02.335273 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-3c0b3ba1-7364-484d-9baa-e09e0baf15d2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.422124 Aug 07 22:39:02.339494 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 101/194] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:01 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:03.359464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-9509d574-0301-46e8-8b7c-97198b0d4879 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:03.360768 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-9509d574-0301-46e8-8b7c-97198b0d4879 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:03.388496 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9509d574-0301-46e8-8b7c-97198b0d4879 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:03.390053 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9509d574-0301-46e8-8b7c-97198b0d4879 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:03.390053 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9509d574-0301-46e8-8b7c-97198b0d4879 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:03.390265 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9509d574-0301-46e8-8b7c-97198b0d4879 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:03.390750 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9509d574-0301-46e8-8b7c-97198b0d4879 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:03.391239 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9509d574-0301-46e8-8b7c-97198b0d4879 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:03.601030 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-9509d574-0301-46e8-8b7c-97198b0d4879 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:03.620512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-9509d574-0301-46e8-8b7c-97198b0d4879 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.265516 Aug 07 22:39:03.628904 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 94/195] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:03 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:04.643180 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-03fb2fb2-86ff-4261-b480-db97e5b45998 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:04.643932 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-03fb2fb2-86ff-4261-b480-db97e5b45998 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:04.651965 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-03fb2fb2-86ff-4261-b480-db97e5b45998 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:04.652483 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-03fb2fb2-86ff-4261-b480-db97e5b45998 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:04.653277 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-03fb2fb2-86ff-4261-b480-db97e5b45998 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:04.654056 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-03fb2fb2-86ff-4261-b480-db97e5b45998 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:04.654509 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-03fb2fb2-86ff-4261-b480-db97e5b45998 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:04.654921 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-03fb2fb2-86ff-4261-b480-db97e5b45998 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:04.843990 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-03fb2fb2-86ff-4261-b480-db97e5b45998 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:04.852923 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-03fb2fb2-86ff-4261-b480-db97e5b45998 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.214870 Aug 07 22:39:04.853493 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 102/196] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:04 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:05.877082 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-e29360be-956e-4df7-8891-3f0f0de7fbbc tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:05.878242 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-e29360be-956e-4df7-8891-3f0f0de7fbbc tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:05.882065 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=38 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:05.889255 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e29360be-956e-4df7-8891-3f0f0de7fbbc tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:05.889740 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e29360be-956e-4df7-8891-3f0f0de7fbbc tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:05.892547 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e29360be-956e-4df7-8891-3f0f0de7fbbc tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:05.892547 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e29360be-956e-4df7-8891-3f0f0de7fbbc tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:05.892547 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e29360be-956e-4df7-8891-3f0f0de7fbbc tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:05.892547 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e29360be-956e-4df7-8891-3f0f0de7fbbc tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:06.048275 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-e29360be-956e-4df7-8891-3f0f0de7fbbc tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:06.057039 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-e29360be-956e-4df7-8891-3f0f0de7fbbc tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.183714 Aug 07 22:39:06.057956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 95/197] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:05 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:07.078565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-d6d3c3ee-ae2a-4c6e-92e6-154cbde62d3d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:07.080697 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-d6d3c3ee-ae2a-4c6e-92e6-154cbde62d3d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:07.085572 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d6d3c3ee-ae2a-4c6e-92e6-154cbde62d3d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:07.086050 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d6d3c3ee-ae2a-4c6e-92e6-154cbde62d3d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:07.086520 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d6d3c3ee-ae2a-4c6e-92e6-154cbde62d3d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:07.087251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d6d3c3ee-ae2a-4c6e-92e6-154cbde62d3d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:07.087693 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d6d3c3ee-ae2a-4c6e-92e6-154cbde62d3d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:07.088174 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d6d3c3ee-ae2a-4c6e-92e6-154cbde62d3d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:07.264956 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-d6d3c3ee-ae2a-4c6e-92e6-154cbde62d3d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:07.272806 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-d6d3c3ee-ae2a-4c6e-92e6-154cbde62d3d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.199478 Aug 07 22:39:07.273428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 103/198] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:07 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:08.294082 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-597a35ba-dc59-4fa4-aac3-d0f705d61721 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:08.294683 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-597a35ba-dc59-4fa4-aac3-d0f705d61721 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:08.301423 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-597a35ba-dc59-4fa4-aac3-d0f705d61721 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:08.301983 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-597a35ba-dc59-4fa4-aac3-d0f705d61721 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:08.302415 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-597a35ba-dc59-4fa4-aac3-d0f705d61721 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:08.303092 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-597a35ba-dc59-4fa4-aac3-d0f705d61721 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:08.303532 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-597a35ba-dc59-4fa4-aac3-d0f705d61721 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:08.303958 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-597a35ba-dc59-4fa4-aac3-d0f705d61721 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:08.499832 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-597a35ba-dc59-4fa4-aac3-d0f705d61721 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:08.507579 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-597a35ba-dc59-4fa4-aac3-d0f705d61721 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.217308 Aug 07 22:39:08.513299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 96/199] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:08 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:09.529712 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f26ba6ff-dffe-4401-a266-e72549cdcdc7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:09.530260 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f26ba6ff-dffe-4401-a266-e72549cdcdc7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:09.536352 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f26ba6ff-dffe-4401-a266-e72549cdcdc7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:09.536996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f26ba6ff-dffe-4401-a266-e72549cdcdc7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:09.537439 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f26ba6ff-dffe-4401-a266-e72549cdcdc7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:09.538123 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f26ba6ff-dffe-4401-a266-e72549cdcdc7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:09.538631 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f26ba6ff-dffe-4401-a266-e72549cdcdc7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:09.540741 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f26ba6ff-dffe-4401-a266-e72549cdcdc7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:09.560075 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:09.680424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f26ba6ff-dffe-4401-a266-e72549cdcdc7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:09.687907 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f26ba6ff-dffe-4401-a266-e72549cdcdc7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.162038 Aug 07 22:39:09.688506 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 104/200] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:09 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:10.708898 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-470979f1-462f-4045-ac1c-65ae88a73980 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:10.709505 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-470979f1-462f-4045-ac1c-65ae88a73980 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:10.716508 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-470979f1-462f-4045-ac1c-65ae88a73980 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:10.716987 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-470979f1-462f-4045-ac1c-65ae88a73980 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:10.717425 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-470979f1-462f-4045-ac1c-65ae88a73980 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:10.718115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-470979f1-462f-4045-ac1c-65ae88a73980 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:10.718568 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-470979f1-462f-4045-ac1c-65ae88a73980 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:10.718994 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-470979f1-462f-4045-ac1c-65ae88a73980 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:10.855589 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-470979f1-462f-4045-ac1c-65ae88a73980 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:10.863679 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-470979f1-462f-4045-ac1c-65ae88a73980 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.158789 Aug 07 22:39:10.864277 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 97/201] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:10 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:11.884836 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-97a56a60-bdf9-4c58-b0f5-ec034450070d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:11.885434 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-97a56a60-bdf9-4c58-b0f5-ec034450070d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:11.893013 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-97a56a60-bdf9-4c58-b0f5-ec034450070d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:11.893550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-97a56a60-bdf9-4c58-b0f5-ec034450070d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:11.893977 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-97a56a60-bdf9-4c58-b0f5-ec034450070d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:11.895099 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-97a56a60-bdf9-4c58-b0f5-ec034450070d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:11.895559 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-97a56a60-bdf9-4c58-b0f5-ec034450070d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:11.895981 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-97a56a60-bdf9-4c58-b0f5-ec034450070d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:12.032150 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-97a56a60-bdf9-4c58-b0f5-ec034450070d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:12.040074 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-97a56a60-bdf9-4c58-b0f5-ec034450070d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.159742 Aug 07 22:39:12.040649 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 105/202] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:11 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:13.061570 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-c1fb1563-7306-4ffe-a0dd-38e0f31433f2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:13.062178 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-c1fb1563-7306-4ffe-a0dd-38e0f31433f2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:13.068570 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c1fb1563-7306-4ffe-a0dd-38e0f31433f2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:13.069045 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c1fb1563-7306-4ffe-a0dd-38e0f31433f2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:13.069479 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c1fb1563-7306-4ffe-a0dd-38e0f31433f2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:13.070826 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c1fb1563-7306-4ffe-a0dd-38e0f31433f2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:13.071277 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c1fb1563-7306-4ffe-a0dd-38e0f31433f2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:13.071697 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c1fb1563-7306-4ffe-a0dd-38e0f31433f2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:13.201026 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-c1fb1563-7306-4ffe-a0dd-38e0f31433f2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:13.208525 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-c1fb1563-7306-4ffe-a0dd-38e0f31433f2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.150734 Aug 07 22:39:13.209091 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 98/203] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:13 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:14.229423 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f2479349-b112-4b92-9e62-4de2931875f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:14.229993 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f2479349-b112-4b92-9e62-4de2931875f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:14.235859 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f2479349-b112-4b92-9e62-4de2931875f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:14.236373 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f2479349-b112-4b92-9e62-4de2931875f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:14.236814 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f2479349-b112-4b92-9e62-4de2931875f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:14.237504 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f2479349-b112-4b92-9e62-4de2931875f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:14.237960 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f2479349-b112-4b92-9e62-4de2931875f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:14.238385 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f2479349-b112-4b92-9e62-4de2931875f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:14.365279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f2479349-b112-4b92-9e62-4de2931875f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:14.373277 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f2479349-b112-4b92-9e62-4de2931875f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.147993 Aug 07 22:39:14.373837 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 106/204] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:14 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:15.394609 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7fb9d5f0-9937-4a37-932d-dbaeecfe96c2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:15.395216 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-7fb9d5f0-9937-4a37-932d-dbaeecfe96c2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:15.402293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7fb9d5f0-9937-4a37-932d-dbaeecfe96c2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:15.402782 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7fb9d5f0-9937-4a37-932d-dbaeecfe96c2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:15.403222 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7fb9d5f0-9937-4a37-932d-dbaeecfe96c2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:15.404828 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7fb9d5f0-9937-4a37-932d-dbaeecfe96c2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:15.404828 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7fb9d5f0-9937-4a37-932d-dbaeecfe96c2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:15.404828 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7fb9d5f0-9937-4a37-932d-dbaeecfe96c2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:15.540721 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7fb9d5f0-9937-4a37-932d-dbaeecfe96c2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:15.549251 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-7fb9d5f0-9937-4a37-932d-dbaeecfe96c2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.158517 Aug 07 22:39:15.549822 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 99/205] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:15 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:16.570145 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-35129e79-9c00-49af-93bf-1b5ee5f02013 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:16.570780 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-35129e79-9c00-49af-93bf-1b5ee5f02013 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:16.577477 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-35129e79-9c00-49af-93bf-1b5ee5f02013 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:16.577960 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-35129e79-9c00-49af-93bf-1b5ee5f02013 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:16.578394 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-35129e79-9c00-49af-93bf-1b5ee5f02013 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:16.579111 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-35129e79-9c00-49af-93bf-1b5ee5f02013 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:16.579563 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-35129e79-9c00-49af-93bf-1b5ee5f02013 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:16.579986 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-35129e79-9c00-49af-93bf-1b5ee5f02013 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:16.707389 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-35129e79-9c00-49af-93bf-1b5ee5f02013 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:16.715557 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-35129e79-9c00-49af-93bf-1b5ee5f02013 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.149510 Aug 07 22:39:16.716265 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 107/206] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:16 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:17.736058 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-774d9723-e730-4f42-9776-4569b9beac0c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:17.736619 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-774d9723-e730-4f42-9776-4569b9beac0c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:17.744308 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-774d9723-e730-4f42-9776-4569b9beac0c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:17.744308 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-774d9723-e730-4f42-9776-4569b9beac0c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:17.744308 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-774d9723-e730-4f42-9776-4569b9beac0c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:17.744956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-774d9723-e730-4f42-9776-4569b9beac0c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:17.745404 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-774d9723-e730-4f42-9776-4569b9beac0c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:17.745875 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-774d9723-e730-4f42-9776-4569b9beac0c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:17.880921 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-774d9723-e730-4f42-9776-4569b9beac0c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:17.889294 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-774d9723-e730-4f42-9776-4569b9beac0c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.157342 Aug 07 22:39:17.889860 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 100/207] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:17 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:18.910902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-9abf1f52-cb35-4b23-ac42-32d04f61f669 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:18.911515 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-9abf1f52-cb35-4b23-ac42-32d04f61f669 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:18.917797 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9abf1f52-cb35-4b23-ac42-32d04f61f669 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:18.918457 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9abf1f52-cb35-4b23-ac42-32d04f61f669 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:18.919143 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9abf1f52-cb35-4b23-ac42-32d04f61f669 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:18.920100 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9abf1f52-cb35-4b23-ac42-32d04f61f669 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:18.921230 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9abf1f52-cb35-4b23-ac42-32d04f61f669 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:18.921747 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9abf1f52-cb35-4b23-ac42-32d04f61f669 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:19.088552 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-9abf1f52-cb35-4b23-ac42-32d04f61f669 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:19.097390 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-9abf1f52-cb35-4b23-ac42-32d04f61f669 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.190322 Aug 07 22:39:19.098353 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 108/208] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:18 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:20.119659 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-5a6bbf7f-220c-4cae-b451-683011bdd158 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:20.120437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-5a6bbf7f-220c-4cae-b451-683011bdd158 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:20.126999 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5a6bbf7f-220c-4cae-b451-683011bdd158 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:20.127491 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5a6bbf7f-220c-4cae-b451-683011bdd158 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:20.127926 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5a6bbf7f-220c-4cae-b451-683011bdd158 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:20.128655 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5a6bbf7f-220c-4cae-b451-683011bdd158 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:20.129326 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5a6bbf7f-220c-4cae-b451-683011bdd158 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:20.129744 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5a6bbf7f-220c-4cae-b451-683011bdd158 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:20.149568 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:20.272579 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-5a6bbf7f-220c-4cae-b451-683011bdd158 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:20.282597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-5a6bbf7f-220c-4cae-b451-683011bdd158 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.167336 Aug 07 22:39:20.298951 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 101/209] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:20 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:21.308822 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-875656e9-436d-4344-ba56-5c08dc64f5f5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:21.309443 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-875656e9-436d-4344-ba56-5c08dc64f5f5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:21.318684 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-875656e9-436d-4344-ba56-5c08dc64f5f5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:21.319306 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-875656e9-436d-4344-ba56-5c08dc64f5f5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:21.320046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-875656e9-436d-4344-ba56-5c08dc64f5f5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:21.321452 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-875656e9-436d-4344-ba56-5c08dc64f5f5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:21.322607 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-875656e9-436d-4344-ba56-5c08dc64f5f5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:21.323608 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-875656e9-436d-4344-ba56-5c08dc64f5f5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:21.483706 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-875656e9-436d-4344-ba56-5c08dc64f5f5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:21.498288 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-875656e9-436d-4344-ba56-5c08dc64f5f5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.197481 Aug 07 22:39:21.500277 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 109/210] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:21 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:39:22.522593 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-51e52171-a6ee-4c95-8cb5-b4143f3d0a99 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:22.523613 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-51e52171-a6ee-4c95-8cb5-b4143f3d0a99 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:22.533007 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-51e52171-a6ee-4c95-8cb5-b4143f3d0a99 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:22.534278 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-51e52171-a6ee-4c95-8cb5-b4143f3d0a99 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:22.535355 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-51e52171-a6ee-4c95-8cb5-b4143f3d0a99 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:22.536214 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-51e52171-a6ee-4c95-8cb5-b4143f3d0a99 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:22.536695 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-51e52171-a6ee-4c95-8cb5-b4143f3d0a99 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:22.537115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-51e52171-a6ee-4c95-8cb5-b4143f3d0a99 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:22.673296 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-51e52171-a6ee-4c95-8cb5-b4143f3d0a99 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:22.681095 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-51e52171-a6ee-4c95-8cb5-b4143f3d0a99 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.163035 Aug 07 22:39:22.681785 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 102/211] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:22 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:23.636378 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-cc4ee42e-a9f1-45a4-be23-efc436825884 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:23.637507 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-cc4ee42e-a9f1-45a4-be23-efc436825884 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:23.643533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cc4ee42e-a9f1-45a4-be23-efc436825884 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:23.644101 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cc4ee42e-a9f1-45a4-be23-efc436825884 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:23.647677 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cc4ee42e-a9f1-45a4-be23-efc436825884 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:23.647677 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cc4ee42e-a9f1-45a4-be23-efc436825884 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:23.647677 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cc4ee42e-a9f1-45a4-be23-efc436825884 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:23.647677 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cc4ee42e-a9f1-45a4-be23-efc436825884 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:23.674237 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-cc4ee42e-a9f1-45a4-be23-efc436825884 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/ips" status: 200 len: 151 microversion: 2.20 time: 0.042361 Aug 07 22:39:23.675007 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 110/212] 10.222.0.30 () {60 vars in 1289 bytes} [Sun Aug 7 22:39:23 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:39:23.706173 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7c0de1bf-4f27-4cf6-943c-7eaf8079cac9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:23.707383 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-7c0de1bf-4f27-4cf6-943c-7eaf8079cac9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:23.718500 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7c0de1bf-4f27-4cf6-943c-7eaf8079cac9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:23.718990 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7c0de1bf-4f27-4cf6-943c-7eaf8079cac9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:23.719425 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7c0de1bf-4f27-4cf6-943c-7eaf8079cac9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:23.720164 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7c0de1bf-4f27-4cf6-943c-7eaf8079cac9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:23.720667 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7c0de1bf-4f27-4cf6-943c-7eaf8079cac9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:23.721092 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7c0de1bf-4f27-4cf6-943c-7eaf8079cac9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:23.873535 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7c0de1bf-4f27-4cf6-943c-7eaf8079cac9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:23.882946 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-7c0de1bf-4f27-4cf6-943c-7eaf8079cac9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.183376 Aug 07 22:39:23.884999 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 103/213] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:23 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:24.905823 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-62a6a29d-dd6d-4874-a927-aadc2b32cf11 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:24.906508 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-62a6a29d-dd6d-4874-a927-aadc2b32cf11 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:24.912412 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-62a6a29d-dd6d-4874-a927-aadc2b32cf11 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:24.912891 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-62a6a29d-dd6d-4874-a927-aadc2b32cf11 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:24.913328 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-62a6a29d-dd6d-4874-a927-aadc2b32cf11 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:24.914043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-62a6a29d-dd6d-4874-a927-aadc2b32cf11 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:24.915248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-62a6a29d-dd6d-4874-a927-aadc2b32cf11 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:24.915775 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-62a6a29d-dd6d-4874-a927-aadc2b32cf11 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:25.077127 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-62a6a29d-dd6d-4874-a927-aadc2b32cf11 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:25.085170 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-62a6a29d-dd6d-4874-a927-aadc2b32cf11 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.183475 Aug 07 22:39:25.099208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 111/214] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:24 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:26.122472 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-59cec52d-b8f2-41a9-b269-436c3edb74db tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:26.122472 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-59cec52d-b8f2-41a9-b269-436c3edb74db tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:26.122472 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-59cec52d-b8f2-41a9-b269-436c3edb74db tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:26.122472 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-59cec52d-b8f2-41a9-b269-436c3edb74db tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:26.123276 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-59cec52d-b8f2-41a9-b269-436c3edb74db tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:26.123276 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-59cec52d-b8f2-41a9-b269-436c3edb74db tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:26.123276 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-59cec52d-b8f2-41a9-b269-436c3edb74db tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:26.123276 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-59cec52d-b8f2-41a9-b269-436c3edb74db tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:26.255362 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-59cec52d-b8f2-41a9-b269-436c3edb74db tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:26.262532 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-2249e348-4371-4944-94d1-8a68971bcfb0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:39:26.263425 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-2249e348-4371-4944-94d1-8a68971bcfb0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:26.269020 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-59cec52d-b8f2-41a9-b269-436c3edb74db tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.165966 Aug 07 22:39:26.269983 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 104/215] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:26 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:26.272168 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2249e348-4371-4944-94d1-8a68971bcfb0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:26.272722 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2249e348-4371-4944-94d1-8a68971bcfb0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:26.273214 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2249e348-4371-4944-94d1-8a68971bcfb0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:26.274639 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2249e348-4371-4944-94d1-8a68971bcfb0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:26.275089 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2249e348-4371-4944-94d1-8a68971bcfb0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:26.275568 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2249e348-4371-4944-94d1-8a68971bcfb0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:26.297774 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.objects.instance [None req-2249e348-4371-4944-94d1-8a68971bcfb0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lazy-loading 'flavor' on Instance uuid 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba {{(pid=129964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:39:26.957526 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-2249e348-4371-4944-94d1-8a68971bcfb0 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "POST /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/action" status: 202 len: 0 microversion: 2.20 time: 0.702427 Aug 07 22:39:26.961599 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 112/216] 10.222.0.30 () {62 vars in 1319 bytes} [Sun Aug 7 22:39:26 2022] POST /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/action => generated 0 bytes in 704 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 22:39:26.966993 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-077a20bc-2378-4280-847f-7fde96de582b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:26.967843 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-077a20bc-2378-4280-847f-7fde96de582b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:26.973788 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-077a20bc-2378-4280-847f-7fde96de582b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:26.974460 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-077a20bc-2378-4280-847f-7fde96de582b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:26.975127 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-077a20bc-2378-4280-847f-7fde96de582b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:26.975820 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-077a20bc-2378-4280-847f-7fde96de582b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:26.976573 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-077a20bc-2378-4280-847f-7fde96de582b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:26.977831 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-077a20bc-2378-4280-847f-7fde96de582b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:27.212816 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-077a20bc-2378-4280-847f-7fde96de582b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:27.220637 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-077a20bc-2378-4280-847f-7fde96de582b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:27.222128 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-077a20bc-2378-4280-847f-7fde96de582b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:27.223279 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-077a20bc-2378-4280-847f-7fde96de582b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1723 microversion: 2.20 time: 0.260537 Aug 07 22:39:27.223831 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 105/217] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:39:26 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:39:27.292922 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-e0b2b1b6-9a08-47fa-88b6-21178b1c2388 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:27.293646 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-e0b2b1b6-9a08-47fa-88b6-21178b1c2388 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:27.302581 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e0b2b1b6-9a08-47fa-88b6-21178b1c2388 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:27.303071 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e0b2b1b6-9a08-47fa-88b6-21178b1c2388 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:27.303512 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e0b2b1b6-9a08-47fa-88b6-21178b1c2388 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:27.304228 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e0b2b1b6-9a08-47fa-88b6-21178b1c2388 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:27.305419 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e0b2b1b6-9a08-47fa-88b6-21178b1c2388 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:27.306074 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e0b2b1b6-9a08-47fa-88b6-21178b1c2388 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:27.495579 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-e0b2b1b6-9a08-47fa-88b6-21178b1c2388 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:27.502277 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-e0b2b1b6-9a08-47fa-88b6-21178b1c2388 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.213792 Aug 07 22:39:27.502912 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 113/218] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:27 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:28.253695 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-4641cffa-09ad-4f48-aa1a-2198ecea6390 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:28.254440 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-4641cffa-09ad-4f48-aa1a-2198ecea6390 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:28.262209 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4641cffa-09ad-4f48-aa1a-2198ecea6390 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:28.264222 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4641cffa-09ad-4f48-aa1a-2198ecea6390 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:28.264222 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4641cffa-09ad-4f48-aa1a-2198ecea6390 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:28.264222 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4641cffa-09ad-4f48-aa1a-2198ecea6390 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:28.265199 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4641cffa-09ad-4f48-aa1a-2198ecea6390 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:28.265716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4641cffa-09ad-4f48-aa1a-2198ecea6390 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:28.416514 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-4641cffa-09ad-4f48-aa1a-2198ecea6390 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:28.424710 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-4641cffa-09ad-4f48-aa1a-2198ecea6390 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:28.426271 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-4641cffa-09ad-4f48-aa1a-2198ecea6390 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:28.427406 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-4641cffa-09ad-4f48-aa1a-2198ecea6390 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1723 microversion: 2.20 time: 0.178088 Aug 07 22:39:28.427982 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 106/219] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:39:28 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:39:28.522558 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-781257e6-8302-4858-9a92-2634d8671216 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:28.523165 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-781257e6-8302-4858-9a92-2634d8671216 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:28.529728 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-781257e6-8302-4858-9a92-2634d8671216 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:28.530200 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-781257e6-8302-4858-9a92-2634d8671216 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:28.530633 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-781257e6-8302-4858-9a92-2634d8671216 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:28.531311 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-781257e6-8302-4858-9a92-2634d8671216 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:28.531759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-781257e6-8302-4858-9a92-2634d8671216 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:28.532211 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-781257e6-8302-4858-9a92-2634d8671216 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:28.678060 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-781257e6-8302-4858-9a92-2634d8671216 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:28.687023 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-781257e6-8302-4858-9a92-2634d8671216 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.168155 Aug 07 22:39:28.687753 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 114/220] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:28 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:29.456414 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-6f033d28-376e-476f-b9da-a5dd25ea86df tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:29.458252 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-6f033d28-376e-476f-b9da-a5dd25ea86df tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:29.487481 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6f033d28-376e-476f-b9da-a5dd25ea86df tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:29.487978 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6f033d28-376e-476f-b9da-a5dd25ea86df tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:29.488437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6f033d28-376e-476f-b9da-a5dd25ea86df tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:29.489138 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6f033d28-376e-476f-b9da-a5dd25ea86df tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:29.492000 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6f033d28-376e-476f-b9da-a5dd25ea86df tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:29.493221 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6f033d28-376e-476f-b9da-a5dd25ea86df tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:29.680485 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-6f033d28-376e-476f-b9da-a5dd25ea86df tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:29.688695 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-6f033d28-376e-476f-b9da-a5dd25ea86df tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:29.691823 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-6f033d28-376e-476f-b9da-a5dd25ea86df tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:29.691823 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-6f033d28-376e-476f-b9da-a5dd25ea86df tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1723 microversion: 2.20 time: 0.243158 Aug 07 22:39:29.692581 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 107/221] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:39:29 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:39:29.709009 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-999ed793-0b0f-4187-97bb-a2d61c3968fa tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:29.709625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-999ed793-0b0f-4187-97bb-a2d61c3968fa tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:29.722617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-999ed793-0b0f-4187-97bb-a2d61c3968fa tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:29.723109 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-999ed793-0b0f-4187-97bb-a2d61c3968fa tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:29.723751 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-999ed793-0b0f-4187-97bb-a2d61c3968fa tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:29.724480 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-999ed793-0b0f-4187-97bb-a2d61c3968fa tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:29.724943 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-999ed793-0b0f-4187-97bb-a2d61c3968fa tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:29.725364 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-999ed793-0b0f-4187-97bb-a2d61c3968fa tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:29.868572 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-999ed793-0b0f-4187-97bb-a2d61c3968fa tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:29.880917 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-999ed793-0b0f-4187-97bb-a2d61c3968fa tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1501 microversion: 2.1 time: 0.174601 Aug 07 22:39:29.881841 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 115/222] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:29 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1501 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:29.909057 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-184b096f-b50a-4350-983f-1f339c3c4d79 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6cbef9b-f4aa-4e26-afca-d33b04d479fb"}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:39:29.911961 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-184b096f-b50a-4350-983f-1f339c3c4d79 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:29.923687 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-184b096f-b50a-4350-983f-1f339c3c4d79 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:29.924211 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-184b096f-b50a-4350-983f-1f339c3c4d79 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:29.924643 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-184b096f-b50a-4350-983f-1f339c3c4d79 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:29.926616 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-184b096f-b50a-4350-983f-1f339c3c4d79 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:29.929416 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-184b096f-b50a-4350-983f-1f339c3c4d79 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:29.929954 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-184b096f-b50a-4350-983f-1f339c3c4d79 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:29.978357 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.wsgi [None req-184b096f-b50a-4350-983f-1f339c3c4d79 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] HTTP exception thrown: Cannot 'attach_volume' instance c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e while it is in vm_state rescued Aug 07 22:39:29.980890 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-184b096f-b50a-4350-983f-1f339c3c4d79 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Request method failure captured: Aug 07 22:39:29.980890 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: request: POST /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e/os-volume_attachments HTTP/1.1 Aug 07 22:39:29.980890 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept: application/json Aug 07 22:39:29.980890 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept-Encoding: identity Aug 07 22:39:29.980890 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Connection: close Aug 07 22:39:29.980890 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Length: 74 Aug 07 22:39:29.980890 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Type: application/json Aug 07 22:39:29.980890 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Host: 10.222.0.30 Aug 07 22:39:29.980890 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Openstack-System-Scope: None Aug 07 22:39:29.980890 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: User-Agent: python-urllib3/1.26.11 Aug 07 22:39:29.980890 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Auth-Token: gAAAAABi8D6s5nO1c7U2MmqVI63h0n43WSrk5CGbs2YynnGh_TABx-q8rxIYvsMGcCP7Nv7JfrcY16P7N3JNnFncFS0_mt8rJCMseLlgBlfUb-RWx8wwGc9OQ2mOe8HxAwiKpQ0fBBAk_n596Ofhngwl4r_Hz2hQEOMQxV8vDBZueD9nBUbzfMg Aug 07 22:39:29.980890 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Id: None Aug 07 22:39:29.980890 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Name: None Aug 07 22:39:29.980890 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Identity-Status: Confirmed Aug 07 22:39:29.980890 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Is-Admin-Project: True Aug 07 22:39:29.980890 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Id: default Aug 07 22:39:29.980890 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Name: Default Aug 07 22:39:29.980890 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Id: 1a78ad9d7151473798fbefa330678250 Aug 07 22:39:29.980890 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-755269189 Aug 07 22:39:29.980890 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Role: reader,member Aug 07 22:39:29.980890 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Roles: reader,member Aug 07 22:39:29.982368 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1a78ad9d7151473798fbefa330678250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1a78ad9d7151473798fbefa330678250"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1a78ad9d7151473798fbefa330678250"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1a78ad9d7151473798fbefa330678250"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:39:29.982368 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant: tempest-ServerRescueNegativeTestJSON-755269189 Aug 07 22:39:29.982368 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Id: 1a78ad9d7151473798fbefa330678250 Aug 07 22:39:29.982368 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-755269189 Aug 07 22:39:29.982368 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User: tempest-ServerRescueNegativeTestJSON-755269189-project Aug 07 22:39:29.982368 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Id: default Aug 07 22:39:29.982368 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Name: Default Aug 07 22:39:29.982368 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Id: 966045fbe69f43b4b1a825da3ad571b9 Aug 07 22:39:29.982368 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Name: tempest-ServerRescueNegativeTestJSON-755269189-project Aug 07 22:39:29.982368 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Aug 07 22:39:29.982368 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {"volumeAttachment": {"volumeId": "d6cbef9b-f4aa-4e26-afca-d33b04d479fb"}} Aug 07 22:39:29.982368 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: method: > Aug 07 22:39:29.983263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: exception: Cannot 'attach_volume' instance c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e while it is in vm_state rescued Aug 07 22:39:29.983263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: action_args: {'server_id': 'c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e', 'body': {'volumeAttachment': {'volumeId': 'd6cbef9b-f4aa-4e26-afca-d33b04d479fb'}}} Aug 07 22:39:29.983263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:39:29.983263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:39:29.983263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 07 22:39:29.983263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 07 22:39:29.983263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 22:39:29.983263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 22:39:29.983263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 07 22:39:29.983263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 07 22:39:29.983263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 07 22:39:29.983263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:39:29.983263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:39:29.983263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:39:29.983263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:39:29.983263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:39:29.983263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:39:29.983263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:39:29.983263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:39:29.984667 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:39:29.984667 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:39:29.984667 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 22:39:29.984667 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 22:39:29.984667 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 22:39:29.984667 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 22:39:29.984667 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 22:39:29.984667 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 22:39:29.984667 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 07 22:39:29.984667 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 07 22:39:29.984667 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 07 22:39:29.984667 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 07 22:39:29.984667 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e while it is in vm_state rescued Aug 07 22:39:29.984667 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:39:29.984667 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:39:29.984667 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:39:29.984667 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:39:29.984667 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:39:29.984667 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:39:29.985899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:39:29.985899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:39:29.985899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e while it is in vm_state rescued Aug 07 22:39:29.985899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:39:29.985899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-184b096f-b50a-4350-983f-1f339c3c4d79 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Returning 409 to user: Cannot 'attach_volume' instance c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e while it is in vm_state rescued {{(pid=129965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:39:29.985899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-184b096f-b50a-4350-983f-1f339c3c4d79 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "POST /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.079806 Aug 07 22:39:29.988574 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 108/223] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 22:39:29 2022] POST /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e/os-volume_attachments => generated 152 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 22:39:29.995125 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-0d3524bb-0a3b-4cac-8a69-f46f82a4177c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:39:29.995971 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-0d3524bb-0a3b-4cac-8a69-f46f82a4177c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:30.006730 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0d3524bb-0a3b-4cac-8a69-f46f82a4177c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:30.006730 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0d3524bb-0a3b-4cac-8a69-f46f82a4177c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:30.006730 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0d3524bb-0a3b-4cac-8a69-f46f82a4177c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:30.006730 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0d3524bb-0a3b-4cac-8a69-f46f82a4177c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:30.007068 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0d3524bb-0a3b-4cac-8a69-f46f82a4177c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:30.007068 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0d3524bb-0a3b-4cac-8a69-f46f82a4177c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:30.255156 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-0d3524bb-0a3b-4cac-8a69-f46f82a4177c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "POST /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e/action" status: 202 len: 0 microversion: 2.1 time: 0.263975 Aug 07 22:39:30.255825 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 116/224] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 22:39:29 2022] POST /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 22:39:30.264519 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-33779dc9-a479-43c5-8190-cc42a3722c63 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:30.265557 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-33779dc9-a479-43c5-8190-cc42a3722c63 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:30.272265 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-33779dc9-a479-43c5-8190-cc42a3722c63 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:30.272777 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-33779dc9-a479-43c5-8190-cc42a3722c63 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:30.273206 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-33779dc9-a479-43c5-8190-cc42a3722c63 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:30.274589 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-33779dc9-a479-43c5-8190-cc42a3722c63 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:30.275063 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-33779dc9-a479-43c5-8190-cc42a3722c63 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:30.275511 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-33779dc9-a479-43c5-8190-cc42a3722c63 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:30.492164 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-33779dc9-a479-43c5-8190-cc42a3722c63 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:30.501380 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-33779dc9-a479-43c5-8190-cc42a3722c63 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1509 microversion: 2.1 time: 0.241016 Aug 07 22:39:30.501973 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 109/225] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:30 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1509 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:30.728904 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-36dd5edc-46eb-48dc-ae40-940a3835bd13 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:30.728904 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-36dd5edc-46eb-48dc-ae40-940a3835bd13 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:30.728904 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-36dd5edc-46eb-48dc-ae40-940a3835bd13 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:30.728904 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-36dd5edc-46eb-48dc-ae40-940a3835bd13 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:30.730317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-36dd5edc-46eb-48dc-ae40-940a3835bd13 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:30.730317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-36dd5edc-46eb-48dc-ae40-940a3835bd13 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:30.730317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-36dd5edc-46eb-48dc-ae40-940a3835bd13 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:30.730317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-36dd5edc-46eb-48dc-ae40-940a3835bd13 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:30.975204 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-36dd5edc-46eb-48dc-ae40-940a3835bd13 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:30.985366 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-36dd5edc-46eb-48dc-ae40-940a3835bd13 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:30.987763 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-36dd5edc-46eb-48dc-ae40-940a3835bd13 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:30.989898 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-36dd5edc-46eb-48dc-ae40-940a3835bd13 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1723 microversion: 2.20 time: 0.278740 Aug 07 22:39:30.990637 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 117/226] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:39:30 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:39:31.525226 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-b102ca3f-19b8-4dc6-9a45-55ad617447c5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:31.532582 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-b102ca3f-19b8-4dc6-9a45-55ad617447c5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:31.546154 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b102ca3f-19b8-4dc6-9a45-55ad617447c5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:31.546641 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b102ca3f-19b8-4dc6-9a45-55ad617447c5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:31.547074 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b102ca3f-19b8-4dc6-9a45-55ad617447c5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:31.547900 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b102ca3f-19b8-4dc6-9a45-55ad617447c5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:31.548392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b102ca3f-19b8-4dc6-9a45-55ad617447c5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:31.548818 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b102ca3f-19b8-4dc6-9a45-55ad617447c5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:31.731775 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-b102ca3f-19b8-4dc6-9a45-55ad617447c5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:31.741188 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-b102ca3f-19b8-4dc6-9a45-55ad617447c5 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1509 microversion: 2.1 time: 0.222294 Aug 07 22:39:31.753787 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 110/227] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:31 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1509 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:32.014769 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f1261fac-952f-41e3-bc47-43f81e8c4396 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:32.015377 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f1261fac-952f-41e3-bc47-43f81e8c4396 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:32.025526 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f1261fac-952f-41e3-bc47-43f81e8c4396 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:32.026028 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f1261fac-952f-41e3-bc47-43f81e8c4396 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:32.026448 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f1261fac-952f-41e3-bc47-43f81e8c4396 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:32.027161 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f1261fac-952f-41e3-bc47-43f81e8c4396 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:32.027611 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f1261fac-952f-41e3-bc47-43f81e8c4396 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:32.028462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f1261fac-952f-41e3-bc47-43f81e8c4396 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:32.055699 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:32.173950 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f1261fac-952f-41e3-bc47-43f81e8c4396 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:32.183934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f1261fac-952f-41e3-bc47-43f81e8c4396 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:32.185880 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f1261fac-952f-41e3-bc47-43f81e8c4396 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:32.187330 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f1261fac-952f-41e3-bc47-43f81e8c4396 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1723 microversion: 2.20 time: 0.176450 Aug 07 22:39:32.188469 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 118/228] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:39:32 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:39:32.765307 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-a718c1e5-0052-48bc-a412-a170fb8ffec4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:32.765916 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-a718c1e5-0052-48bc-a412-a170fb8ffec4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:32.775141 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a718c1e5-0052-48bc-a412-a170fb8ffec4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:32.775629 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a718c1e5-0052-48bc-a412-a170fb8ffec4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:32.776544 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a718c1e5-0052-48bc-a412-a170fb8ffec4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:32.777716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a718c1e5-0052-48bc-a412-a170fb8ffec4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:32.778372 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a718c1e5-0052-48bc-a412-a170fb8ffec4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:32.778794 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a718c1e5-0052-48bc-a412-a170fb8ffec4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:32.919728 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-a718c1e5-0052-48bc-a412-a170fb8ffec4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:32.929417 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-a718c1e5-0052-48bc-a412-a170fb8ffec4 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1509 microversion: 2.1 time: 0.167641 Aug 07 22:39:32.931010 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 111/229] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:32 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:33.211593 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-d3e9830b-e917-4ce4-98a0-cbe0d8534260 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:33.213486 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-d3e9830b-e917-4ce4-98a0-cbe0d8534260 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:33.214425 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_api:SELECT=38 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:33.219492 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d3e9830b-e917-4ce4-98a0-cbe0d8534260 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:33.219962 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d3e9830b-e917-4ce4-98a0-cbe0d8534260 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:33.220413 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d3e9830b-e917-4ce4-98a0-cbe0d8534260 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:33.221094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d3e9830b-e917-4ce4-98a0-cbe0d8534260 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:33.222177 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d3e9830b-e917-4ce4-98a0-cbe0d8534260 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:33.222605 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d3e9830b-e917-4ce4-98a0-cbe0d8534260 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:33.375181 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-d3e9830b-e917-4ce4-98a0-cbe0d8534260 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:33.383384 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-d3e9830b-e917-4ce4-98a0-cbe0d8534260 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:33.385818 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-d3e9830b-e917-4ce4-98a0-cbe0d8534260 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:33.389557 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-d3e9830b-e917-4ce4-98a0-cbe0d8534260 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1723 microversion: 2.20 time: 0.180108 Aug 07 22:39:33.389557 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 119/230] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:39:33 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:39:33.951872 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-db8cfa14-b417-4361-8ac7-e4f156f3af28 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:33.952585 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-db8cfa14-b417-4361-8ac7-e4f156f3af28 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:33.962390 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-db8cfa14-b417-4361-8ac7-e4f156f3af28 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:33.963333 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-db8cfa14-b417-4361-8ac7-e4f156f3af28 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:33.964236 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-db8cfa14-b417-4361-8ac7-e4f156f3af28 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:33.966031 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-db8cfa14-b417-4361-8ac7-e4f156f3af28 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:33.966592 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-db8cfa14-b417-4361-8ac7-e4f156f3af28 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:33.967116 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-db8cfa14-b417-4361-8ac7-e4f156f3af28 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:34.247404 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-db8cfa14-b417-4361-8ac7-e4f156f3af28 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:34.257373 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-db8cfa14-b417-4361-8ac7-e4f156f3af28 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1515 microversion: 2.1 time: 0.309909 Aug 07 22:39:34.258095 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 112/231] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:33 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1515 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:34.410619 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f7f2c129-2dbd-4f9d-81cd-8bdc3bc9ff4c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:34.411760 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f7f2c129-2dbd-4f9d-81cd-8bdc3bc9ff4c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:34.418878 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f7f2c129-2dbd-4f9d-81cd-8bdc3bc9ff4c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:34.419582 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f7f2c129-2dbd-4f9d-81cd-8bdc3bc9ff4c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:34.422375 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f7f2c129-2dbd-4f9d-81cd-8bdc3bc9ff4c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:34.422375 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f7f2c129-2dbd-4f9d-81cd-8bdc3bc9ff4c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:34.422375 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f7f2c129-2dbd-4f9d-81cd-8bdc3bc9ff4c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:34.422375 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f7f2c129-2dbd-4f9d-81cd-8bdc3bc9ff4c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:34.712290 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f7f2c129-2dbd-4f9d-81cd-8bdc3bc9ff4c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:34.722442 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f7f2c129-2dbd-4f9d-81cd-8bdc3bc9ff4c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:34.726427 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f7f2c129-2dbd-4f9d-81cd-8bdc3bc9ff4c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:34.726427 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f7f2c129-2dbd-4f9d-81cd-8bdc3bc9ff4c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1723 microversion: 2.20 time: 0.319342 Aug 07 22:39:34.726840 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 120/232] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:39:34 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1723 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:39:35.752183 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-41fca13a-c6f6-4fb7-88d4-a4c4ed46a3f4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:35.754505 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-41fca13a-c6f6-4fb7-88d4-a4c4ed46a3f4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:35.763115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-41fca13a-c6f6-4fb7-88d4-a4c4ed46a3f4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:35.763607 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-41fca13a-c6f6-4fb7-88d4-a4c4ed46a3f4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:35.764104 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-41fca13a-c6f6-4fb7-88d4-a4c4ed46a3f4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:35.764959 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-41fca13a-c6f6-4fb7-88d4-a4c4ed46a3f4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:35.765577 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-41fca13a-c6f6-4fb7-88d4-a4c4ed46a3f4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:35.766161 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-41fca13a-c6f6-4fb7-88d4-a4c4ed46a3f4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:35.920816 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-41fca13a-c6f6-4fb7-88d4-a4c4ed46a3f4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:35.947715 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-41fca13a-c6f6-4fb7-88d4-a4c4ed46a3f4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:35.949773 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-41fca13a-c6f6-4fb7-88d4-a4c4ed46a3f4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:35.951229 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-41fca13a-c6f6-4fb7-88d4-a4c4ed46a3f4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1723 microversion: 2.20 time: 0.202946 Aug 07 22:39:35.952269 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 113/233] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:39:35 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:39:36.050895 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-bc0c8ec2-8b43-41a1-8f30-fb25ee83a80c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Action: 'create', calling method: .version_select at 0x7fc09fe7bd30>, body: {"keypair": {"name": "tempest-keypair-940536888", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBORzBk0uyMpqtMvqjM4EBJfMm2zopElO4MAlds7gZje6s3MEnJNIxi/6nzT2Q7KzyzKzt7Z8Do6Zoh3Ltk84s68WmbV7lzrKPM9WOmPORrjS4r/dJu7jR0CAad7p6DBNg=="}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:39:36.069072 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-bc0c8ec2-8b43-41a1-8f30-fb25ee83a80c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Getting quotas for project 1a78ad9d7151473798fbefa330678250. Resources: {'key_pairs'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:39:36.073697 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-bc0c8ec2-8b43-41a1-8f30-fb25ee83a80c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Getting quotas for user 966045fbe69f43b4b1a825da3ad571b9 and project 1a78ad9d7151473798fbefa330678250. Resources: {'key_pairs'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:39:36.171276 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-bc0c8ec2-8b43-41a1-8f30-fb25ee83a80c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.124285 Aug 07 22:39:36.175113 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 121/234] 10.222.0.30 () {60 vars in 1159 bytes} [Sun Aug 7 22:39:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:39:36.982313 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-9dd32b65-5d31-41ea-8267-2641768f1a33 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:36.982827 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-9dd32b65-5d31-41ea-8267-2641768f1a33 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:36.991445 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9dd32b65-5d31-41ea-8267-2641768f1a33 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:36.992849 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9dd32b65-5d31-41ea-8267-2641768f1a33 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:37.006589 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9dd32b65-5d31-41ea-8267-2641768f1a33 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:37.006589 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9dd32b65-5d31-41ea-8267-2641768f1a33 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:37.006589 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9dd32b65-5d31-41ea-8267-2641768f1a33 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:37.006589 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9dd32b65-5d31-41ea-8267-2641768f1a33 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:37.260272 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-9dd32b65-5d31-41ea-8267-2641768f1a33 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:37.269826 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-9dd32b65-5d31-41ea-8267-2641768f1a33 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:37.271354 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-9dd32b65-5d31-41ea-8267-2641768f1a33 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:37.272560 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-9dd32b65-5d31-41ea-8267-2641768f1a33 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1723 microversion: 2.20 time: 0.294250 Aug 07 22:39:37.273121 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 114/235] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:39:36 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:39:38.296626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-c8e4ff28-c5cd-452a-a59c-30af4d82d001 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:38.297367 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-c8e4ff28-c5cd-452a-a59c-30af4d82d001 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:38.309431 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c8e4ff28-c5cd-452a-a59c-30af4d82d001 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:38.309973 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c8e4ff28-c5cd-452a-a59c-30af4d82d001 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:38.312984 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c8e4ff28-c5cd-452a-a59c-30af4d82d001 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:38.313714 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c8e4ff28-c5cd-452a-a59c-30af4d82d001 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:38.314178 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c8e4ff28-c5cd-452a-a59c-30af4d82d001 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:38.314599 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c8e4ff28-c5cd-452a-a59c-30af4d82d001 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:38.539271 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-c8e4ff28-c5cd-452a-a59c-30af4d82d001 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:38.548347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-c8e4ff28-c5cd-452a-a59c-30af4d82d001 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:38.552311 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-c8e4ff28-c5cd-452a-a59c-30af4d82d001 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:38.553763 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-c8e4ff28-c5cd-452a-a59c-30af4d82d001 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1723 microversion: 2.20 time: 0.261667 Aug 07 22:39:38.555184 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 122/236] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:39:38 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:39:39.055075 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7af83a71-5927-4049-ae4f-01a693f9c570 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-903031160", "imageRef": "91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b379400c-91c0-4503-ac16-d8b7f1c793d1"}], "security_groups": [{"name": "tempest-securitygroup--179216929"}], "key_name": "tempest-keypair-940536888", "user_data": "}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:39:39.064748 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=40 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:39.167421 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.network.neutron [None req-7af83a71-5927-4049-ae4f-01a693f9c570 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] validate_networks() for [('b379400c-91c0-4503-ac16-d8b7f1c793d1', None, None, None, None, None)] {{(pid=129965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 22:39:39.579893 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-88442df5-b1ca-4b1a-bc39-bc4d71647983 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:39.579893 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-88442df5-b1ca-4b1a-bc39-bc4d71647983 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:39.589734 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-88442df5-b1ca-4b1a-bc39-bc4d71647983 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:39.590183 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-88442df5-b1ca-4b1a-bc39-bc4d71647983 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:39.590612 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-88442df5-b1ca-4b1a-bc39-bc4d71647983 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:39.591355 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-88442df5-b1ca-4b1a-bc39-bc4d71647983 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:39.591736 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-88442df5-b1ca-4b1a-bc39-bc4d71647983 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:39.592175 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-88442df5-b1ca-4b1a-bc39-bc4d71647983 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:39.601926 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-7af83a71-5927-4049-ae4f-01a693f9c570 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Flavor limits 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 22:39:39.602492 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-7af83a71-5927-4049-ae4f-01a693f9c570 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Image limits 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 22:39:39.603142 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-7af83a71-5927-4049-ae4f-01a693f9c570 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Flavor pref 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 22:39:39.603694 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-7af83a71-5927-4049-ae4f-01a693f9c570 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Image pref 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 22:39:39.604589 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-7af83a71-5927-4049-ae4f-01a693f9c570 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 22:39:39.618600 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7af83a71-5927-4049-ae4f-01a693f9c570 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:39.625348 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7af83a71-5927-4049-ae4f-01a693f9c570 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:39.632302 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7af83a71-5927-4049-ae4f-01a693f9c570 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:39.632302 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7af83a71-5927-4049-ae4f-01a693f9c570 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:39.632302 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7af83a71-5927-4049-ae4f-01a693f9c570 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:39.632302 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7af83a71-5927-4049-ae4f-01a693f9c570 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:39.663831 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-7af83a71-5927-4049-ae4f-01a693f9c570 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Getting quotas for project 1a78ad9d7151473798fbefa330678250. Resources: {'cores', 'instances', 'ram'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:39:39.672307 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-7af83a71-5927-4049-ae4f-01a693f9c570 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Getting quotas for user 966045fbe69f43b4b1a825da3ad571b9 and project 1a78ad9d7151473798fbefa330678250. Resources: {'cores', 'instances', 'ram'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:39:39.704407 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-7af83a71-5927-4049-ae4f-01a693f9c570 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Going to run 1 instances... {{(pid=129965) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 22:39:39.704407 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-7af83a71-5927-4049-ae4f-01a693f9c570 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 22:39:39.785903 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-88442df5-b1ca-4b1a-bc39-bc4d71647983 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:39.795547 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-88442df5-b1ca-4b1a-bc39-bc4d71647983 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:39.797490 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-88442df5-b1ca-4b1a-bc39-bc4d71647983 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:39.798660 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-88442df5-b1ca-4b1a-bc39-bc4d71647983 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1723 microversion: 2.20 time: 0.225006 Aug 07 22:39:39.799342 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 123/237] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:39:39 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:39:39.842681 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-7af83a71-5927-4049-ae4f-01a693f9c570 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.791968 Aug 07 22:39:39.843231 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 115/238] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 22:39:39 2022] POST /compute/v2.1/servers => generated 408 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 22:39:39.855078 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a42e3337-0777-4b06-a1c0-af81112844cf tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:39.855766 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a42e3337-0777-4b06-a1c0-af81112844cf tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:39.924638 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-a42e3337-0777-4b06-a1c0-af81112844cf tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:39.938323 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a42e3337-0777-4b06-a1c0-af81112844cf tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1244 microversion: 2.1 time: 0.088385 Aug 07 22:39:39.939068 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 124/239] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:39 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:40.817397 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-bca1c3ee-6805-4a89-9086-d3d6159dbc06 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-73168441", "imageRef": "91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8", "flavorRef": "452", "networks": [{"uuid": "7a262e81-b8e7-4431-9b78-e1d6df4bd6f9"}]}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:39:40.826002 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-274d2e8c-7b22-4d3d-9e39-0d75ce9deb81 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:40.826614 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-274d2e8c-7b22-4d3d-9e39-0d75ce9deb81 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:40.834493 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-274d2e8c-7b22-4d3d-9e39-0d75ce9deb81 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:40.844888 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-274d2e8c-7b22-4d3d-9e39-0d75ce9deb81 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:40.845387 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-274d2e8c-7b22-4d3d-9e39-0d75ce9deb81 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:40.846263 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-274d2e8c-7b22-4d3d-9e39-0d75ce9deb81 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:40.846721 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-274d2e8c-7b22-4d3d-9e39-0d75ce9deb81 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:40.847221 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-274d2e8c-7b22-4d3d-9e39-0d75ce9deb81 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:40.917983 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.network.neutron [None req-bca1c3ee-6805-4a89-9086-d3d6159dbc06 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] validate_networks() for [('7a262e81-b8e7-4431-9b78-e1d6df4bd6f9', None, None, None, None, None)] {{(pid=129965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 22:39:41.142546 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-274d2e8c-7b22-4d3d-9e39-0d75ce9deb81 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:41.156869 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-274d2e8c-7b22-4d3d-9e39-0d75ce9deb81 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:41.158575 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-274d2e8c-7b22-4d3d-9e39-0d75ce9deb81 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:41.165403 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-274d2e8c-7b22-4d3d-9e39-0d75ce9deb81 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1723 microversion: 2.20 time: 0.343423 Aug 07 22:39:41.166181 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 125/240] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:39:40 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1723 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:39:41.171230 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-e6c22dfa-d5d7-4da4-925b-ac16ba948921 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:41.171865 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-e6c22dfa-d5d7-4da4-925b-ac16ba948921 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:41.203106 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e6c22dfa-d5d7-4da4-925b-ac16ba948921 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:41.204677 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e6c22dfa-d5d7-4da4-925b-ac16ba948921 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:41.205314 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e6c22dfa-d5d7-4da4-925b-ac16ba948921 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:41.207599 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e6c22dfa-d5d7-4da4-925b-ac16ba948921 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:41.208755 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e6c22dfa-d5d7-4da4-925b-ac16ba948921 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:41.209197 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e6c22dfa-d5d7-4da4-925b-ac16ba948921 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:41.558566 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-e6c22dfa-d5d7-4da4-925b-ac16ba948921 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:41.566575 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-e6c22dfa-d5d7-4da4-925b-ac16ba948921 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1240 microversion: 2.1 time: 0.399581 Aug 07 22:39:41.567223 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 126/241] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:41 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1240 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:41.701011 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-bca1c3ee-6805-4a89-9086-d3d6159dbc06 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Flavor limits 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 22:39:41.701435 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-bca1c3ee-6805-4a89-9086-d3d6159dbc06 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Image limits 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 22:39:41.701909 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-bca1c3ee-6805-4a89-9086-d3d6159dbc06 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Flavor pref 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 22:39:41.702357 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-bca1c3ee-6805-4a89-9086-d3d6159dbc06 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Image pref 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 22:39:41.702797 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-bca1c3ee-6805-4a89-9086-d3d6159dbc06 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 22:39:41.713699 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bca1c3ee-6805-4a89-9086-d3d6159dbc06 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:41.713699 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bca1c3ee-6805-4a89-9086-d3d6159dbc06 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:41.713699 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bca1c3ee-6805-4a89-9086-d3d6159dbc06 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:41.713974 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bca1c3ee-6805-4a89-9086-d3d6159dbc06 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:41.714426 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bca1c3ee-6805-4a89-9086-d3d6159dbc06 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:41.714849 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bca1c3ee-6805-4a89-9086-d3d6159dbc06 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:41.733201 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-bca1c3ee-6805-4a89-9086-d3d6159dbc06 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Getting quotas for project 5eea609cee794549a2c23cdb24fbb572. Resources: {'cores', 'instances', 'ram'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:39:41.737064 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-bca1c3ee-6805-4a89-9086-d3d6159dbc06 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Getting quotas for user def1da13ff2a47ada8e5f453061e3f7c and project 5eea609cee794549a2c23cdb24fbb572. Resources: {'cores', 'instances', 'ram'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:39:41.749622 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-bca1c3ee-6805-4a89-9086-d3d6159dbc06 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Going to run 1 instances... {{(pid=129965) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 22:39:41.751742 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-bca1c3ee-6805-4a89-9086-d3d6159dbc06 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 22:39:41.860206 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-bca1c3ee-6805-4a89-9086-d3d6159dbc06 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.047678 Aug 07 22:39:41.866704 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 116/242] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 22:39:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 22:39:41.877531 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-bc241ce0-569a-409f-8006-56baf74358a8 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:41.884114 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-bc241ce0-569a-409f-8006-56baf74358a8 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:41.951250 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-bc241ce0-569a-409f-8006-56baf74358a8 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:41.958566 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-bc241ce0-569a-409f-8006-56baf74358a8 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 200 len: 1217 microversion: 2.1 time: 0.089525 Aug 07 22:39:41.976143 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 127/243] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:41 2022] GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:42.193290 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-5ecaaca2-69a8-46c8-aeb0-5f1011adfc7f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:42.194097 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-5ecaaca2-69a8-46c8-aeb0-5f1011adfc7f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:42.204059 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5ecaaca2-69a8-46c8-aeb0-5f1011adfc7f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:42.204597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5ecaaca2-69a8-46c8-aeb0-5f1011adfc7f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:42.208288 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5ecaaca2-69a8-46c8-aeb0-5f1011adfc7f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:42.208288 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5ecaaca2-69a8-46c8-aeb0-5f1011adfc7f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:42.208288 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5ecaaca2-69a8-46c8-aeb0-5f1011adfc7f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:42.208288 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5ecaaca2-69a8-46c8-aeb0-5f1011adfc7f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:42.507732 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-5ecaaca2-69a8-46c8-aeb0-5f1011adfc7f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:42.527249 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-5ecaaca2-69a8-46c8-aeb0-5f1011adfc7f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:42.529102 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-5ecaaca2-69a8-46c8-aeb0-5f1011adfc7f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:42.531082 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-5ecaaca2-69a8-46c8-aeb0-5f1011adfc7f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1723 microversion: 2.20 time: 0.342074 Aug 07 22:39:42.544339 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 117/244] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:39:42 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1723 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:39:42.598667 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f15e548e-4cb3-438b-9f11-db1bc9077100 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:42.601008 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f15e548e-4cb3-438b-9f11-db1bc9077100 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:42.627134 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f15e548e-4cb3-438b-9f11-db1bc9077100 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:42.627640 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f15e548e-4cb3-438b-9f11-db1bc9077100 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:42.628420 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f15e548e-4cb3-438b-9f11-db1bc9077100 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:42.630026 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f15e548e-4cb3-438b-9f11-db1bc9077100 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:42.630593 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f15e548e-4cb3-438b-9f11-db1bc9077100 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:42.631027 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f15e548e-4cb3-438b-9f11-db1bc9077100 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:42.752246 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f15e548e-4cb3-438b-9f11-db1bc9077100 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:42.758560 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f15e548e-4cb3-438b-9f11-db1bc9077100 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1302 microversion: 2.1 time: 0.168994 Aug 07 22:39:42.758560 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 128/245] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:42 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1302 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:42.986001 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-3e839dcf-776e-461c-9c9e-475fa0fea972 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:42.986608 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-3e839dcf-776e-461c-9c9e-475fa0fea972 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:43.044401 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-3e839dcf-776e-461c-9c9e-475fa0fea972 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:43.052520 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-3e839dcf-776e-461c-9c9e-475fa0fea972 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 200 len: 1217 microversion: 2.1 time: 0.070231 Aug 07 22:39:43.053091 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 118/246] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:42 2022] GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:43.555556 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-1d9a1c98-9c1f-4c4e-bcf9-6ce38751aec1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:43.556469 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-1d9a1c98-9c1f-4c4e-bcf9-6ce38751aec1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:43.563619 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1d9a1c98-9c1f-4c4e-bcf9-6ce38751aec1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:43.564198 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1d9a1c98-9c1f-4c4e-bcf9-6ce38751aec1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:43.564795 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1d9a1c98-9c1f-4c4e-bcf9-6ce38751aec1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:43.565643 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1d9a1c98-9c1f-4c4e-bcf9-6ce38751aec1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:43.566243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1d9a1c98-9c1f-4c4e-bcf9-6ce38751aec1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:43.569627 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1d9a1c98-9c1f-4c4e-bcf9-6ce38751aec1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:43.760997 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-1d9a1c98-9c1f-4c4e-bcf9-6ce38751aec1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:43.777100 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-90174dcf-e008-4b57-a6bf-846f5ea228c2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:43.780386 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-90174dcf-e008-4b57-a6bf-846f5ea228c2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:43.794045 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-1d9a1c98-9c1f-4c4e-bcf9-6ce38751aec1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:43.800727 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-90174dcf-e008-4b57-a6bf-846f5ea228c2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:43.805613 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-90174dcf-e008-4b57-a6bf-846f5ea228c2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:43.805863 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-1d9a1c98-9c1f-4c4e-bcf9-6ce38751aec1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:43.805863 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-1d9a1c98-9c1f-4c4e-bcf9-6ce38751aec1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1744 microversion: 2.20 time: 0.253206 Aug 07 22:39:43.806775 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-90174dcf-e008-4b57-a6bf-846f5ea228c2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:43.809723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-90174dcf-e008-4b57-a6bf-846f5ea228c2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:43.824046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 129/247] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:39:43 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1744 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:39:43.824560 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-90174dcf-e008-4b57-a6bf-846f5ea228c2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:43.825752 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-90174dcf-e008-4b57-a6bf-846f5ea228c2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:44.075140 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-861c55e2-e59e-4833-b2a9-b23b56be5d59 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:44.076178 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-861c55e2-e59e-4833-b2a9-b23b56be5d59 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:44.077065 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-90174dcf-e008-4b57-a6bf-846f5ea228c2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:44.088145 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-90174dcf-e008-4b57-a6bf-846f5ea228c2 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1369 microversion: 2.1 time: 0.315200 Aug 07 22:39:44.088441 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-861c55e2-e59e-4833-b2a9-b23b56be5d59 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:44.089282 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-861c55e2-e59e-4833-b2a9-b23b56be5d59 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:44.089470 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 119/248] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:43 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1369 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:39:44.090141 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-861c55e2-e59e-4833-b2a9-b23b56be5d59 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:44.090854 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-861c55e2-e59e-4833-b2a9-b23b56be5d59 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:44.091315 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-861c55e2-e59e-4833-b2a9-b23b56be5d59 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:44.091740 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-861c55e2-e59e-4833-b2a9-b23b56be5d59 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:44.190999 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-861c55e2-e59e-4833-b2a9-b23b56be5d59 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:44.198655 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-861c55e2-e59e-4833-b2a9-b23b56be5d59 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 200 len: 1269 microversion: 2.1 time: 0.128850 Aug 07 22:39:44.199221 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 130/249] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:44 2022] GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 1269 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:39:44.325547 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-39360402-08e9-4d0a-a0b4-035a98a90659 req-ab20d658-8970-4123-8616-e5273ceb87fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62959a95-0c79-4d83-a375-147271e53ffa", "tag": "ffa75a68-45f7-47ee-941b-97d714ef438e"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:39:44.336123 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-39360402-08e9-4d0a-a0b4-035a98a90659 req-ab20d658-8970-4123-8616-e5273ceb87fa service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:44.336986 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-39360402-08e9-4d0a-a0b4-035a98a90659 req-ab20d658-8970-4123-8616-e5273ceb87fa service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:44.337780 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-39360402-08e9-4d0a-a0b4-035a98a90659 req-ab20d658-8970-4123-8616-e5273ceb87fa service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:44.525023 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-39360402-08e9-4d0a-a0b4-035a98a90659 req-ab20d658-8970-4123-8616-e5273ceb87fa service nova] Creating event network-changed:ffa75a68-45f7-47ee-941b-97d714ef438e for instance 62959a95-0c79-4d83-a375-147271e53ffa on hv-cinder-85032 Aug 07 22:39:44.530399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-39360402-08e9-4d0a-a0b4-035a98a90659 req-ab20d658-8970-4123-8616-e5273ceb87fa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208557 Aug 07 22:39:44.531196 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 120/250] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:39:44.842717 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-7ecb64e0-5af8-4cd5-b145-5cf807c6301b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:44.843317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-7ecb64e0-5af8-4cd5-b145-5cf807c6301b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:44.854128 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7ecb64e0-5af8-4cd5-b145-5cf807c6301b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:44.856308 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7ecb64e0-5af8-4cd5-b145-5cf807c6301b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:44.856751 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7ecb64e0-5af8-4cd5-b145-5cf807c6301b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:44.857460 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7ecb64e0-5af8-4cd5-b145-5cf807c6301b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:44.857960 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7ecb64e0-5af8-4cd5-b145-5cf807c6301b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:44.859800 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7ecb64e0-5af8-4cd5-b145-5cf807c6301b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:45.113059 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-80758149-6dcb-4ded-b6c1-acf5c867c6a6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:45.113971 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-80758149-6dcb-4ded-b6c1-acf5c867c6a6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:45.127663 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-80758149-6dcb-4ded-b6c1-acf5c867c6a6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:45.132843 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-80758149-6dcb-4ded-b6c1-acf5c867c6a6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:45.133628 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-80758149-6dcb-4ded-b6c1-acf5c867c6a6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:45.135237 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-80758149-6dcb-4ded-b6c1-acf5c867c6a6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:45.135916 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-80758149-6dcb-4ded-b6c1-acf5c867c6a6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:45.136518 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-80758149-6dcb-4ded-b6c1-acf5c867c6a6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:45.161417 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=100 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:45.194220 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-7ecb64e0-5af8-4cd5-b145-5cf807c6301b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:45.229179 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-7ecb64e0-5af8-4cd5-b145-5cf807c6301b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:45.234338 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-7ecb64e0-5af8-4cd5-b145-5cf807c6301b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:45.248833 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-7ecb64e0-5af8-4cd5-b145-5cf807c6301b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1744 microversion: 2.20 time: 0.397569 Aug 07 22:39:45.248833 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 131/251] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:39:44 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1744 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:39:45.251518 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-ed82b66c-bc48-469e-8397-bcf3536d93c9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:45.255385 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-ed82b66c-bc48-469e-8397-bcf3536d93c9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:45.271013 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ed82b66c-bc48-469e-8397-bcf3536d93c9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:45.271690 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ed82b66c-bc48-469e-8397-bcf3536d93c9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:45.272372 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ed82b66c-bc48-469e-8397-bcf3536d93c9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:45.273329 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ed82b66c-bc48-469e-8397-bcf3536d93c9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:45.274047 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ed82b66c-bc48-469e-8397-bcf3536d93c9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:45.274674 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ed82b66c-bc48-469e-8397-bcf3536d93c9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:45.400289 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-80758149-6dcb-4ded-b6c1-acf5c867c6a6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:45.409534 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-80758149-6dcb-4ded-b6c1-acf5c867c6a6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1369 microversion: 2.1 time: 0.303982 Aug 07 22:39:45.410713 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 121/252] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:45 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1369 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:39:45.419729 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-ed82b66c-bc48-469e-8397-bcf3536d93c9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:45.427324 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-ed82b66c-bc48-469e-8397-bcf3536d93c9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 200 len: 1275 microversion: 2.1 time: 0.183176 Aug 07 22:39:45.435112 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 132/253] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:45 2022] GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 1275 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:46.274534 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d539e385-16a9-4dde-bfce-6612de1e7f20 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:46.275212 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-d539e385-16a9-4dde-bfce-6612de1e7f20 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:46.286160 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d539e385-16a9-4dde-bfce-6612de1e7f20 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:46.286870 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d539e385-16a9-4dde-bfce-6612de1e7f20 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:46.287470 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d539e385-16a9-4dde-bfce-6612de1e7f20 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:46.289375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d539e385-16a9-4dde-bfce-6612de1e7f20 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:46.290175 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d539e385-16a9-4dde-bfce-6612de1e7f20 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:46.290768 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d539e385-16a9-4dde-bfce-6612de1e7f20 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:46.432578 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-868042d6-8ee3-4fcb-94e9-028d8987a86d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:46.433325 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-868042d6-8ee3-4fcb-94e9-028d8987a86d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:46.440558 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-868042d6-8ee3-4fcb-94e9-028d8987a86d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:46.441124 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-868042d6-8ee3-4fcb-94e9-028d8987a86d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:46.441517 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-868042d6-8ee3-4fcb-94e9-028d8987a86d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:46.442269 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-868042d6-8ee3-4fcb-94e9-028d8987a86d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:46.442722 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-868042d6-8ee3-4fcb-94e9-028d8987a86d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:46.443210 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-868042d6-8ee3-4fcb-94e9-028d8987a86d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:46.555859 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-d539e385-16a9-4dde-bfce-6612de1e7f20 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:46.571545 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-d539e385-16a9-4dde-bfce-6612de1e7f20 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:46.574311 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-d539e385-16a9-4dde-bfce-6612de1e7f20 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:46.575932 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-d539e385-16a9-4dde-bfce-6612de1e7f20 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1744 microversion: 2.20 time: 0.311475 Aug 07 22:39:46.594019 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 122/254] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:39:46 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1744 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:39:46.605226 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d0356e18-9dc7-4c5f-acae-392e951c4cb3 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:46.606221 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-d0356e18-9dc7-4c5f-acae-392e951c4cb3 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:46.616172 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d0356e18-9dc7-4c5f-acae-392e951c4cb3 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:46.616741 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d0356e18-9dc7-4c5f-acae-392e951c4cb3 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:46.617886 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d0356e18-9dc7-4c5f-acae-392e951c4cb3 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:46.619090 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d0356e18-9dc7-4c5f-acae-392e951c4cb3 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:46.619542 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d0356e18-9dc7-4c5f-acae-392e951c4cb3 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:46.620149 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d0356e18-9dc7-4c5f-acae-392e951c4cb3 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:47.113909 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-868042d6-8ee3-4fcb-94e9-028d8987a86d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:47.120590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-868042d6-8ee3-4fcb-94e9-028d8987a86d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1369 microversion: 2.1 time: 0.693536 Aug 07 22:39:47.123417 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 133/255] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:46 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1369 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:47.130765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-a1ebf596-e7d4-4607-8fac-99ade330752f req-f96d728b-25aa-48fa-b18b-3eff6a05ef17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bda9470-bb0f-45e2-9f1b-e4d1db51aeba", "name": "network-vif-plugged", "status": "completed", "tag": "1f737453-339e-4e1d-8c0b-b401edea34b1"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:39:47.154081 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-a1ebf596-e7d4-4607-8fac-99ade330752f req-f96d728b-25aa-48fa-b18b-3eff6a05ef17 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:47.159308 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-a1ebf596-e7d4-4607-8fac-99ade330752f req-f96d728b-25aa-48fa-b18b-3eff6a05ef17 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:47.160545 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-a1ebf596-e7d4-4607-8fac-99ade330752f req-f96d728b-25aa-48fa-b18b-3eff6a05ef17 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:47.182012 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-a1ebf596-e7d4-4607-8fac-99ade330752f req-f96d728b-25aa-48fa-b18b-3eff6a05ef17 service nova] Creating event network-vif-plugged:1f737453-339e-4e1d-8c0b-b401edea34b1 for instance 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba on hv-cinder-85032 Aug 07 22:39:47.187508 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-a1ebf596-e7d4-4607-8fac-99ade330752f req-f96d728b-25aa-48fa-b18b-3eff6a05ef17 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062395 Aug 07 22:39:47.191199 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 134/256] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:39:47.216366 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-d0356e18-9dc7-4c5f-acae-392e951c4cb3 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:47.224290 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-d0356e18-9dc7-4c5f-acae-392e951c4cb3 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 200 len: 1317 microversion: 2.1 time: 0.627696 Aug 07 22:39:47.225011 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 123/257] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:46 2022] GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 1317 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:47.607437 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-e40aea99-ecfb-4609-bda8-047c6beff3be tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:47.608763 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-e40aea99-ecfb-4609-bda8-047c6beff3be tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:47.615198 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e40aea99-ecfb-4609-bda8-047c6beff3be tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:47.615887 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e40aea99-ecfb-4609-bda8-047c6beff3be tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:47.616504 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e40aea99-ecfb-4609-bda8-047c6beff3be tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:47.617260 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e40aea99-ecfb-4609-bda8-047c6beff3be tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:47.617865 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e40aea99-ecfb-4609-bda8-047c6beff3be tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:47.618504 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e40aea99-ecfb-4609-bda8-047c6beff3be tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:47.744887 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-8394cea3-2743-459f-a4f1-18fc627c3b28 req-aa916e42-3ce7-4d43-b281-bd3647b582cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24f48cf3-8b19-480b-b271-eef00858dbf2", "tag": "4b161e96-ab40-40a7-94b4-baefa79fd50f"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:39:47.756687 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-8394cea3-2743-459f-a4f1-18fc627c3b28 req-aa916e42-3ce7-4d43-b281-bd3647b582cb service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:47.758315 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-8394cea3-2743-459f-a4f1-18fc627c3b28 req-aa916e42-3ce7-4d43-b281-bd3647b582cb service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:47.759491 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-8394cea3-2743-459f-a4f1-18fc627c3b28 req-aa916e42-3ce7-4d43-b281-bd3647b582cb service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:47.775655 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-8394cea3-2743-459f-a4f1-18fc627c3b28 req-aa916e42-3ce7-4d43-b281-bd3647b582cb service nova] Creating event network-changed:4b161e96-ab40-40a7-94b4-baefa79fd50f for instance 24f48cf3-8b19-480b-b271-eef00858dbf2 on hv-cinder-85032 Aug 07 22:39:47.781161 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-8394cea3-2743-459f-a4f1-18fc627c3b28 req-aa916e42-3ce7-4d43-b281-bd3647b582cb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041739 Aug 07 22:39:47.782097 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 124/258] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:39:47.859351 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-e40aea99-ecfb-4609-bda8-047c6beff3be tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:47.875508 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-e40aea99-ecfb-4609-bda8-047c6beff3be tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:47.878577 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-e40aea99-ecfb-4609-bda8-047c6beff3be tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:47.878577 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-e40aea99-ecfb-4609-bda8-047c6beff3be tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1739 microversion: 2.20 time: 0.274982 Aug 07 22:39:47.879434 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 135/259] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:39:47 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1739 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:39:48.145406 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-a68192ef-4573-492d-a56b-6809d98c5630 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:48.146113 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-a68192ef-4573-492d-a56b-6809d98c5630 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:48.152833 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a68192ef-4573-492d-a56b-6809d98c5630 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:48.153321 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a68192ef-4573-492d-a56b-6809d98c5630 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:48.153759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a68192ef-4573-492d-a56b-6809d98c5630 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:48.154694 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a68192ef-4573-492d-a56b-6809d98c5630 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:48.155169 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a68192ef-4573-492d-a56b-6809d98c5630 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:48.155670 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a68192ef-4573-492d-a56b-6809d98c5630 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:48.246790 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-8cae1d50-22d6-4886-a51c-74e418895f45 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:48.247565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-8cae1d50-22d6-4886-a51c-74e418895f45 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:48.256267 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8cae1d50-22d6-4886-a51c-74e418895f45 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:48.257115 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8cae1d50-22d6-4886-a51c-74e418895f45 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:48.259014 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8cae1d50-22d6-4886-a51c-74e418895f45 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:48.259768 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8cae1d50-22d6-4886-a51c-74e418895f45 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:48.260328 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8cae1d50-22d6-4886-a51c-74e418895f45 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:48.260960 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8cae1d50-22d6-4886-a51c-74e418895f45 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:48.497563 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-a68192ef-4573-492d-a56b-6809d98c5630 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:48.508545 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-a68192ef-4573-492d-a56b-6809d98c5630 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1369 microversion: 2.1 time: 0.367376 Aug 07 22:39:48.512312 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 125/260] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:48 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1369 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:48.559454 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-8cae1d50-22d6-4886-a51c-74e418895f45 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:48.568409 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-8cae1d50-22d6-4886-a51c-74e418895f45 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 200 len: 1317 microversion: 2.1 time: 0.326534 Aug 07 22:39:48.569240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 136/261] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:48 2022] GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:39:48.916033 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-519b4bbd-a8d6-4df6-a16b-6b53a5543696 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:48.916742 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-519b4bbd-a8d6-4df6-a16b-6b53a5543696 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:48.923130 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-519b4bbd-a8d6-4df6-a16b-6b53a5543696 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:48.923685 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-519b4bbd-a8d6-4df6-a16b-6b53a5543696 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:48.924145 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-519b4bbd-a8d6-4df6-a16b-6b53a5543696 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:48.924837 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-519b4bbd-a8d6-4df6-a16b-6b53a5543696 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:48.925286 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-519b4bbd-a8d6-4df6-a16b-6b53a5543696 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:48.925713 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-519b4bbd-a8d6-4df6-a16b-6b53a5543696 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:49.148480 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-519b4bbd-a8d6-4df6-a16b-6b53a5543696 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:49.163106 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-519b4bbd-a8d6-4df6-a16b-6b53a5543696 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:49.167212 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-519b4bbd-a8d6-4df6-a16b-6b53a5543696 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:49.169396 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-519b4bbd-a8d6-4df6-a16b-6b53a5543696 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1739 microversion: 2.20 time: 0.259201 Aug 07 22:39:49.191430 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 126/262] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:39:48 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1739 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:39:49.535991 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-08c82d61-e1cf-400a-a4d8-8b6807b466ba tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:49.536623 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-08c82d61-e1cf-400a-a4d8-8b6807b466ba tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:49.547646 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-08c82d61-e1cf-400a-a4d8-8b6807b466ba tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:49.550323 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-08c82d61-e1cf-400a-a4d8-8b6807b466ba tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:49.551689 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-08c82d61-e1cf-400a-a4d8-8b6807b466ba tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:49.553176 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-08c82d61-e1cf-400a-a4d8-8b6807b466ba tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:49.556506 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-08c82d61-e1cf-400a-a4d8-8b6807b466ba tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:49.557131 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-08c82d61-e1cf-400a-a4d8-8b6807b466ba tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:49.598971 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-e6a19479-a241-467b-84b6-e3ad8afce62e tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:49.600708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-e6a19479-a241-467b-84b6-e3ad8afce62e tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:49.619216 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e6a19479-a241-467b-84b6-e3ad8afce62e tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:49.621312 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e6a19479-a241-467b-84b6-e3ad8afce62e tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:49.623740 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e6a19479-a241-467b-84b6-e3ad8afce62e tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:49.625495 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e6a19479-a241-467b-84b6-e3ad8afce62e tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:49.626354 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e6a19479-a241-467b-84b6-e3ad8afce62e tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:49.626997 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e6a19479-a241-467b-84b6-e3ad8afce62e tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:50.153657 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-e6a19479-a241-467b-84b6-e3ad8afce62e tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:50.161480 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-e6a19479-a241-467b-84b6-e3ad8afce62e tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 200 len: 1317 microversion: 2.1 time: 0.575613 Aug 07 22:39:50.162143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 127/263] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:49 2022] GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 1317 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:50.182370 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-08c82d61-e1cf-400a-a4d8-8b6807b466ba tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:50.190238 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-08c82d61-e1cf-400a-a4d8-8b6807b466ba tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1369 microversion: 2.1 time: 0.660086 Aug 07 22:39:50.203974 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 137/264] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:49 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1369 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:50.205847 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-8a3965a1-de4e-4f22-8345-4fb4d2b24138 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:50.206506 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-8a3965a1-de4e-4f22-8345-4fb4d2b24138 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:50.218921 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8a3965a1-de4e-4f22-8345-4fb4d2b24138 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:50.219625 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8a3965a1-de4e-4f22-8345-4fb4d2b24138 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:50.220457 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8a3965a1-de4e-4f22-8345-4fb4d2b24138 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:50.220710 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8a3965a1-de4e-4f22-8345-4fb4d2b24138 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:50.221134 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8a3965a1-de4e-4f22-8345-4fb4d2b24138 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:50.221753 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8a3965a1-de4e-4f22-8345-4fb4d2b24138 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:50.612293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8a3965a1-de4e-4f22-8345-4fb4d2b24138 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:50.626371 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8a3965a1-de4e-4f22-8345-4fb4d2b24138 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:50.629088 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8a3965a1-de4e-4f22-8345-4fb4d2b24138 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:50.635247 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-8a3965a1-de4e-4f22-8345-4fb4d2b24138 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1739 microversion: 2.20 time: 0.443977 Aug 07 22:39:50.637615 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 128/265] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:39:50 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1739 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:39:51.189033 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-352e5781-2b7e-4c7c-a9c0-88bf3bf294f9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:51.194554 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-352e5781-2b7e-4c7c-a9c0-88bf3bf294f9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:51.211909 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-1ac4450c-5e35-4a94-8366-1464bdd5b67f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:51.213216 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-1ac4450c-5e35-4a94-8366-1464bdd5b67f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:51.228861 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-352e5781-2b7e-4c7c-a9c0-88bf3bf294f9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:51.229350 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-352e5781-2b7e-4c7c-a9c0-88bf3bf294f9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:51.229781 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-352e5781-2b7e-4c7c-a9c0-88bf3bf294f9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:51.230483 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-352e5781-2b7e-4c7c-a9c0-88bf3bf294f9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:51.230943 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-352e5781-2b7e-4c7c-a9c0-88bf3bf294f9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:51.231342 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-352e5781-2b7e-4c7c-a9c0-88bf3bf294f9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:51.235643 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1ac4450c-5e35-4a94-8366-1464bdd5b67f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:51.239525 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1ac4450c-5e35-4a94-8366-1464bdd5b67f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:51.244421 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1ac4450c-5e35-4a94-8366-1464bdd5b67f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:51.245507 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1ac4450c-5e35-4a94-8366-1464bdd5b67f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:51.251460 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1ac4450c-5e35-4a94-8366-1464bdd5b67f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:51.252178 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1ac4450c-5e35-4a94-8366-1464bdd5b67f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:51.621704 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-1ac4450c-5e35-4a94-8366-1464bdd5b67f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:51.630604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-1ac4450c-5e35-4a94-8366-1464bdd5b67f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1369 microversion: 2.1 time: 0.423583 Aug 07 22:39:51.631723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 129/266] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:51 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1369 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:51.633601 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-352e5781-2b7e-4c7c-a9c0-88bf3bf294f9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:51.637661 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=100 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:51.645468 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-352e5781-2b7e-4c7c-a9c0-88bf3bf294f9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 200 len: 1317 microversion: 2.1 time: 0.466508 Aug 07 22:39:51.646046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 138/267] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:51 2022] GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:51.668657 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7dfbd3af-9775-4efd-b869-37d86f269635 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:51.669667 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-7dfbd3af-9775-4efd-b869-37d86f269635 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:51.684377 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7dfbd3af-9775-4efd-b869-37d86f269635 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:51.696667 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7dfbd3af-9775-4efd-b869-37d86f269635 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:51.697242 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7dfbd3af-9775-4efd-b869-37d86f269635 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:51.698380 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7dfbd3af-9775-4efd-b869-37d86f269635 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:51.699170 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7dfbd3af-9775-4efd-b869-37d86f269635 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:51.700526 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7dfbd3af-9775-4efd-b869-37d86f269635 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:51.757535 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=4 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:52.097840 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7dfbd3af-9775-4efd-b869-37d86f269635 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:52.111265 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7dfbd3af-9775-4efd-b869-37d86f269635 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:52.113061 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7dfbd3af-9775-4efd-b869-37d86f269635 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:52.114802 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-7dfbd3af-9775-4efd-b869-37d86f269635 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1739 microversion: 2.20 time: 0.454054 Aug 07 22:39:52.115439 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 130/268] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:39:51 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1739 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:39:52.657549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-1c9af098-9fe4-41af-8784-ecf254f56130 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:52.658180 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-1c9af098-9fe4-41af-8784-ecf254f56130 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:52.660184 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=8 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:52.671159 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1c9af098-9fe4-41af-8784-ecf254f56130 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:52.671159 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1c9af098-9fe4-41af-8784-ecf254f56130 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:52.671159 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1c9af098-9fe4-41af-8784-ecf254f56130 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:52.671159 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1c9af098-9fe4-41af-8784-ecf254f56130 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:52.671797 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1c9af098-9fe4-41af-8784-ecf254f56130 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:52.672031 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1c9af098-9fe4-41af-8784-ecf254f56130 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:52.673686 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-9de49b46-6d45-4262-af85-2449e8689e90 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:52.674692 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-9de49b46-6d45-4262-af85-2449e8689e90 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:52.686401 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9de49b46-6d45-4262-af85-2449e8689e90 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:52.687588 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9de49b46-6d45-4262-af85-2449e8689e90 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:52.718830 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9de49b46-6d45-4262-af85-2449e8689e90 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:52.720308 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9de49b46-6d45-4262-af85-2449e8689e90 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:52.721141 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9de49b46-6d45-4262-af85-2449e8689e90 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:52.721932 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9de49b46-6d45-4262-af85-2449e8689e90 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:53.049287 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=14 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:39:53.202732 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-1c9af098-9fe4-41af-8784-ecf254f56130 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:53.222477 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-1c9af098-9fe4-41af-8784-ecf254f56130 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1369 microversion: 2.1 time: 0.571396 Aug 07 22:39:53.235314 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 139/269] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:52 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1369 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:53.246906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-87692b60-3cdd-4a84-8bcb-f9466a44c1df tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:53.254271 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-9de49b46-6d45-4262-af85-2449e8689e90 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:53.267014 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-87692b60-3cdd-4a84-8bcb-f9466a44c1df tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:53.267976 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-9de49b46-6d45-4262-af85-2449e8689e90 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 200 len: 1317 microversion: 2.1 time: 0.599663 Aug 07 22:39:53.272158 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 131/270] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:52 2022] GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 1317 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:39:53.276638 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-87692b60-3cdd-4a84-8bcb-f9466a44c1df tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:53.277300 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-87692b60-3cdd-4a84-8bcb-f9466a44c1df tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:53.278084 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-87692b60-3cdd-4a84-8bcb-f9466a44c1df tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:53.278796 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-87692b60-3cdd-4a84-8bcb-f9466a44c1df tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:53.279399 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-87692b60-3cdd-4a84-8bcb-f9466a44c1df tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:53.279982 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-87692b60-3cdd-4a84-8bcb-f9466a44c1df tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:53.546795 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-87692b60-3cdd-4a84-8bcb-f9466a44c1df tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:53.557295 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-87692b60-3cdd-4a84-8bcb-f9466a44c1df tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:53.560885 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-87692b60-3cdd-4a84-8bcb-f9466a44c1df tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:53.562411 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-87692b60-3cdd-4a84-8bcb-f9466a44c1df tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1739 microversion: 2.20 time: 0.320636 Aug 07 22:39:53.577061 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 140/271] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:39:53 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1739 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:39:54.250619 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-92e12e57-c1a3-44dc-9b8d-3f5da67b6a6a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:54.250619 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-92e12e57-c1a3-44dc-9b8d-3f5da67b6a6a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:54.267827 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-92e12e57-c1a3-44dc-9b8d-3f5da67b6a6a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:54.270835 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-92e12e57-c1a3-44dc-9b8d-3f5da67b6a6a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:54.271326 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-92e12e57-c1a3-44dc-9b8d-3f5da67b6a6a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:54.272098 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-92e12e57-c1a3-44dc-9b8d-3f5da67b6a6a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:54.272582 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-92e12e57-c1a3-44dc-9b8d-3f5da67b6a6a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:54.273585 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-92e12e57-c1a3-44dc-9b8d-3f5da67b6a6a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:54.302213 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-3e61135e-57c3-4412-812a-c253eea7049e tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:54.302817 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-3e61135e-57c3-4412-812a-c253eea7049e tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:54.315605 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3e61135e-57c3-4412-812a-c253eea7049e tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:54.322744 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3e61135e-57c3-4412-812a-c253eea7049e tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:54.326968 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3e61135e-57c3-4412-812a-c253eea7049e tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:54.326968 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3e61135e-57c3-4412-812a-c253eea7049e tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:54.326968 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3e61135e-57c3-4412-812a-c253eea7049e tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:54.327489 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3e61135e-57c3-4412-812a-c253eea7049e tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:54.638508 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-92e12e57-c1a3-44dc-9b8d-3f5da67b6a6a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:54.656387 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-92e12e57-c1a3-44dc-9b8d-3f5da67b6a6a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1369 microversion: 2.1 time: 0.409176 Aug 07 22:39:54.658794 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 132/272] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:54 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1369 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:54.673901 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-fbd8456d-608d-44f7-9f3d-ce75b99d60b4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:54.675097 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-fbd8456d-608d-44f7-9f3d-ce75b99d60b4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:54.689677 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fbd8456d-608d-44f7-9f3d-ce75b99d60b4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:54.690953 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-3e61135e-57c3-4412-812a-c253eea7049e tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:54.691097 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fbd8456d-608d-44f7-9f3d-ce75b99d60b4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:54.691939 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fbd8456d-608d-44f7-9f3d-ce75b99d60b4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:54.693449 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fbd8456d-608d-44f7-9f3d-ce75b99d60b4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:54.694203 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fbd8456d-608d-44f7-9f3d-ce75b99d60b4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:54.695392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fbd8456d-608d-44f7-9f3d-ce75b99d60b4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:54.703683 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-3e61135e-57c3-4412-812a-c253eea7049e tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 200 len: 1317 microversion: 2.1 time: 0.403065 Aug 07 22:39:54.704706 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 141/273] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:54 2022] GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 1317 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:55.077177 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-fbd8456d-608d-44f7-9f3d-ce75b99d60b4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:55.091691 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-fbd8456d-608d-44f7-9f3d-ce75b99d60b4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:55.096421 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-fbd8456d-608d-44f7-9f3d-ce75b99d60b4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:55.104945 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-fbd8456d-608d-44f7-9f3d-ce75b99d60b4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1739 microversion: 2.20 time: 0.435540 Aug 07 22:39:55.104945 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 133/274] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:39:54 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1739 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:39:55.681643 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-4b76adc8-2575-4d1b-9440-433faa6d5e2b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:55.685099 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-4b76adc8-2575-4d1b-9440-433faa6d5e2b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:55.695008 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4b76adc8-2575-4d1b-9440-433faa6d5e2b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:55.695538 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4b76adc8-2575-4d1b-9440-433faa6d5e2b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:55.695974 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4b76adc8-2575-4d1b-9440-433faa6d5e2b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:55.700182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4b76adc8-2575-4d1b-9440-433faa6d5e2b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:55.702140 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4b76adc8-2575-4d1b-9440-433faa6d5e2b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:55.704305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4b76adc8-2575-4d1b-9440-433faa6d5e2b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:55.729944 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-53eb2060-f7dc-487d-bb87-3f578d47feb3 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:55.730761 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-53eb2060-f7dc-487d-bb87-3f578d47feb3 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:55.754647 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-53eb2060-f7dc-487d-bb87-3f578d47feb3 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:55.758779 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-53eb2060-f7dc-487d-bb87-3f578d47feb3 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:55.760749 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-53eb2060-f7dc-487d-bb87-3f578d47feb3 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:55.764289 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-53eb2060-f7dc-487d-bb87-3f578d47feb3 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:55.764939 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-53eb2060-f7dc-487d-bb87-3f578d47feb3 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:55.768625 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-53eb2060-f7dc-487d-bb87-3f578d47feb3 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:56.102192 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-4b76adc8-2575-4d1b-9440-433faa6d5e2b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:56.114290 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-4b76adc8-2575-4d1b-9440-433faa6d5e2b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1369 microversion: 2.1 time: 0.437131 Aug 07 22:39:56.128091 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 142/275] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:55 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1369 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:56.137949 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a55c4cd0-5106-4f09-b5d2-188c81f3001c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:56.142459 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-53eb2060-f7dc-487d-bb87-3f578d47feb3 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:56.151442 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-53eb2060-f7dc-487d-bb87-3f578d47feb3 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 200 len: 1317 microversion: 2.1 time: 0.426372 Aug 07 22:39:56.152050 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 134/276] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:55 2022] GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 1317 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:56.152464 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a55c4cd0-5106-4f09-b5d2-188c81f3001c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:56.158916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a55c4cd0-5106-4f09-b5d2-188c81f3001c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:56.159394 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a55c4cd0-5106-4f09-b5d2-188c81f3001c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:56.160239 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a55c4cd0-5106-4f09-b5d2-188c81f3001c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:56.161120 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a55c4cd0-5106-4f09-b5d2-188c81f3001c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:56.161757 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a55c4cd0-5106-4f09-b5d2-188c81f3001c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:56.162177 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a55c4cd0-5106-4f09-b5d2-188c81f3001c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:56.518979 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-a55c4cd0-5106-4f09-b5d2-188c81f3001c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:56.532566 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-a55c4cd0-5106-4f09-b5d2-188c81f3001c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:56.534816 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-a55c4cd0-5106-4f09-b5d2-188c81f3001c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:56.536809 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a55c4cd0-5106-4f09-b5d2-188c81f3001c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1739 microversion: 2.20 time: 0.407212 Aug 07 22:39:56.537388 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 143/277] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:39:56 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1739 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:39:57.143516 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7d033c29-c49d-44c5-a839-21ad6c7ae4fe tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:57.144935 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-7d033c29-c49d-44c5-a839-21ad6c7ae4fe tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:57.155982 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7d033c29-c49d-44c5-a839-21ad6c7ae4fe tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:57.157485 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7d033c29-c49d-44c5-a839-21ad6c7ae4fe tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:57.157931 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7d033c29-c49d-44c5-a839-21ad6c7ae4fe tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:57.158641 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7d033c29-c49d-44c5-a839-21ad6c7ae4fe tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:57.159102 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7d033c29-c49d-44c5-a839-21ad6c7ae4fe tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:57.159525 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7d033c29-c49d-44c5-a839-21ad6c7ae4fe tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:57.175138 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-7bedd55f-7d92-4b55-93e1-f529e6d6fdaf tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:57.176402 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-7bedd55f-7d92-4b55-93e1-f529e6d6fdaf tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:57.191792 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7bedd55f-7d92-4b55-93e1-f529e6d6fdaf tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:57.191792 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7bedd55f-7d92-4b55-93e1-f529e6d6fdaf tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:57.191792 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7bedd55f-7d92-4b55-93e1-f529e6d6fdaf tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:57.191792 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7bedd55f-7d92-4b55-93e1-f529e6d6fdaf tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:57.192354 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7bedd55f-7d92-4b55-93e1-f529e6d6fdaf tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:57.192354 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7bedd55f-7d92-4b55-93e1-f529e6d6fdaf tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:57.524199 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7d033c29-c49d-44c5-a839-21ad6c7ae4fe tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:57.537540 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-7d033c29-c49d-44c5-a839-21ad6c7ae4fe tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1369 microversion: 2.1 time: 0.398362 Aug 07 22:39:57.539924 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 135/278] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:57 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1369 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:57.573867 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7c4c173c-a22a-4c62-86e7-68c3776abed5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:57.574773 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-7c4c173c-a22a-4c62-86e7-68c3776abed5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:57.584940 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7c4c173c-a22a-4c62-86e7-68c3776abed5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:57.593249 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-7bedd55f-7d92-4b55-93e1-f529e6d6fdaf tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:57.597024 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7c4c173c-a22a-4c62-86e7-68c3776abed5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:57.597466 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7c4c173c-a22a-4c62-86e7-68c3776abed5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:57.598199 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7c4c173c-a22a-4c62-86e7-68c3776abed5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:57.598648 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7c4c173c-a22a-4c62-86e7-68c3776abed5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:57.599098 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7c4c173c-a22a-4c62-86e7-68c3776abed5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:57.607939 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-7bedd55f-7d92-4b55-93e1-f529e6d6fdaf tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 200 len: 1317 microversion: 2.1 time: 0.438454 Aug 07 22:39:57.608727 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 144/279] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:57 2022] GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 1317 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:57.853276 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7c4c173c-a22a-4c62-86e7-68c3776abed5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:57.864506 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7c4c173c-a22a-4c62-86e7-68c3776abed5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:57.866308 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7c4c173c-a22a-4c62-86e7-68c3776abed5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:57.867883 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-7c4c173c-a22a-4c62-86e7-68c3776abed5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1739 microversion: 2.20 time: 0.302288 Aug 07 22:39:57.868641 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 136/280] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:39:57 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1739 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:39:58.559604 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-8a7b8215-f26d-4867-aaba-b7c59e0a1508 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:58.560238 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-8a7b8215-f26d-4867-aaba-b7c59e0a1508 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:58.569471 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8a7b8215-f26d-4867-aaba-b7c59e0a1508 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:58.574396 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8a7b8215-f26d-4867-aaba-b7c59e0a1508 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:58.575278 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8a7b8215-f26d-4867-aaba-b7c59e0a1508 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:58.578050 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8a7b8215-f26d-4867-aaba-b7c59e0a1508 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:58.578050 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8a7b8215-f26d-4867-aaba-b7c59e0a1508 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:58.578050 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8a7b8215-f26d-4867-aaba-b7c59e0a1508 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:58.632227 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-9c1f1155-a408-4c17-9a45-c58a7c28eaf9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:58.633809 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-9c1f1155-a408-4c17-9a45-c58a7c28eaf9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:58.642756 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9c1f1155-a408-4c17-9a45-c58a7c28eaf9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:58.650239 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9c1f1155-a408-4c17-9a45-c58a7c28eaf9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:58.651322 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9c1f1155-a408-4c17-9a45-c58a7c28eaf9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:58.653310 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9c1f1155-a408-4c17-9a45-c58a7c28eaf9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:58.654008 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9c1f1155-a408-4c17-9a45-c58a7c28eaf9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:58.654947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9c1f1155-a408-4c17-9a45-c58a7c28eaf9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:58.857356 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-8a7b8215-f26d-4867-aaba-b7c59e0a1508 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:58.866354 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-8a7b8215-f26d-4867-aaba-b7c59e0a1508 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1369 microversion: 2.1 time: 0.310612 Aug 07 22:39:58.881471 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 145/281] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:58 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1369 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:58.895056 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-8e6fc62a-2726-42d3-b0a4-e0d0c34e80f8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:58.895915 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-8e6fc62a-2726-42d3-b0a4-e0d0c34e80f8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:58.909305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8e6fc62a-2726-42d3-b0a4-e0d0c34e80f8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:58.910051 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8e6fc62a-2726-42d3-b0a4-e0d0c34e80f8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:58.910637 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8e6fc62a-2726-42d3-b0a4-e0d0c34e80f8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:58.913742 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8e6fc62a-2726-42d3-b0a4-e0d0c34e80f8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:58.922349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8e6fc62a-2726-42d3-b0a4-e0d0c34e80f8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:58.922976 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8e6fc62a-2726-42d3-b0a4-e0d0c34e80f8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:58.952980 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-9c1f1155-a408-4c17-9a45-c58a7c28eaf9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:58.968839 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-9c1f1155-a408-4c17-9a45-c58a7c28eaf9 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 200 len: 1317 microversion: 2.1 time: 0.343256 Aug 07 22:39:58.969420 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 137/282] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:58 2022] GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:39:59.586463 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-8e6fc62a-2726-42d3-b0a4-e0d0c34e80f8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:59.600218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-8e6fc62a-2726-42d3-b0a4-e0d0c34e80f8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:59.626330 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-8e6fc62a-2726-42d3-b0a4-e0d0c34e80f8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:39:59.630227 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-8e6fc62a-2726-42d3-b0a4-e0d0c34e80f8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1739 microversion: 2.20 time: 0.740402 Aug 07 22:39:59.634412 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 146/283] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:39:58 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1739 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:39:59.892753 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-6b737155-5369-4f0f-b21b-b42b2a3c53c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:59.893526 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-6b737155-5369-4f0f-b21b-b42b2a3c53c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:39:59.908268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6b737155-5369-4f0f-b21b-b42b2a3c53c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:59.908268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6b737155-5369-4f0f-b21b-b42b2a3c53c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:59.908268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6b737155-5369-4f0f-b21b-b42b2a3c53c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:59.908268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6b737155-5369-4f0f-b21b-b42b2a3c53c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:39:59.908636 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6b737155-5369-4f0f-b21b-b42b2a3c53c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:39:59.908636 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6b737155-5369-4f0f-b21b-b42b2a3c53c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:39:59.993016 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-cb497f7d-ab1b-496f-a798-56e214f5fbf0 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:39:59.993016 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-cb497f7d-ab1b-496f-a798-56e214f5fbf0 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:00.004289 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cb497f7d-ab1b-496f-a798-56e214f5fbf0 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:00.005119 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cb497f7d-ab1b-496f-a798-56e214f5fbf0 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:00.005764 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cb497f7d-ab1b-496f-a798-56e214f5fbf0 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:00.007533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cb497f7d-ab1b-496f-a798-56e214f5fbf0 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:00.008251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cb497f7d-ab1b-496f-a798-56e214f5fbf0 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:00.011641 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cb497f7d-ab1b-496f-a798-56e214f5fbf0 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:00.483068 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-cb497f7d-ab1b-496f-a798-56e214f5fbf0 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:00.494036 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-cb497f7d-ab1b-496f-a798-56e214f5fbf0 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 200 len: 1317 microversion: 2.1 time: 0.505354 Aug 07 22:40:00.507906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 147/284] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:59 2022] GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 1317 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:40:00.530333 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-d93c23f6-ac4c-4c06-9855-0b30d7674fcf req-52493769-9ab1-4ae0-86ed-8fd6391ed4bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62959a95-0c79-4d83-a375-147271e53ffa", "name": "network-vif-plugged", "status": "completed", "tag": "ffa75a68-45f7-47ee-941b-97d714ef438e"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:40:00.548691 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-6b737155-5369-4f0f-b21b-b42b2a3c53c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:00.550731 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-d93c23f6-ac4c-4c06-9855-0b30d7674fcf req-52493769-9ab1-4ae0-86ed-8fd6391ed4bd service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:00.551459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-d93c23f6-ac4c-4c06-9855-0b30d7674fcf req-52493769-9ab1-4ae0-86ed-8fd6391ed4bd service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:00.552174 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-d93c23f6-ac4c-4c06-9855-0b30d7674fcf req-52493769-9ab1-4ae0-86ed-8fd6391ed4bd service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:00.555414 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=100 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:40:00.566153 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-d93c23f6-ac4c-4c06-9855-0b30d7674fcf req-52493769-9ab1-4ae0-86ed-8fd6391ed4bd service nova] Creating event network-vif-plugged:ffa75a68-45f7-47ee-941b-97d714ef438e for instance 62959a95-0c79-4d83-a375-147271e53ffa on hv-cinder-85032 Aug 07 22:40:00.567845 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-6b737155-5369-4f0f-b21b-b42b2a3c53c6 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1369 microversion: 2.1 time: 0.680840 Aug 07 22:40:00.573170 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-d93c23f6-ac4c-4c06-9855-0b30d7674fcf req-52493769-9ab1-4ae0-86ed-8fd6391ed4bd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063200 Aug 07 22:40:00.574145 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 148/285] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:40:00.582823 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 138/286] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:39:59 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1369 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:40:00.658779 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-10e16799-623f-4398-84b8-3601d7949a05 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:00.660792 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-10e16799-623f-4398-84b8-3601d7949a05 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:00.673685 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-10e16799-623f-4398-84b8-3601d7949a05 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:00.673685 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-10e16799-623f-4398-84b8-3601d7949a05 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:00.673685 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-10e16799-623f-4398-84b8-3601d7949a05 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:00.673685 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-10e16799-623f-4398-84b8-3601d7949a05 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:00.674568 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-10e16799-623f-4398-84b8-3601d7949a05 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:00.675098 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-10e16799-623f-4398-84b8-3601d7949a05 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:00.942055 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-10e16799-623f-4398-84b8-3601d7949a05 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:00.952495 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-10e16799-623f-4398-84b8-3601d7949a05 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:00.954852 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-10e16799-623f-4398-84b8-3601d7949a05 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:00.957496 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-10e16799-623f-4398-84b8-3601d7949a05 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1739 microversion: 2.20 time: 0.305092 Aug 07 22:40:00.959010 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 149/287] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:00 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1739 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:01.516583 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-2dfac734-efed-4578-a473-fdc5e36f740a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:01.517190 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-2dfac734-efed-4578-a473-fdc5e36f740a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:01.526579 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2dfac734-efed-4578-a473-fdc5e36f740a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:01.532355 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2dfac734-efed-4578-a473-fdc5e36f740a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:01.533205 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2dfac734-efed-4578-a473-fdc5e36f740a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:01.534265 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2dfac734-efed-4578-a473-fdc5e36f740a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:01.536199 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2dfac734-efed-4578-a473-fdc5e36f740a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:01.536857 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2dfac734-efed-4578-a473-fdc5e36f740a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:01.603335 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-dbc813ac-e2b7-4dd8-b65f-51a777b2df67 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:01.606855 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-dbc813ac-e2b7-4dd8-b65f-51a777b2df67 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:01.622432 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dbc813ac-e2b7-4dd8-b65f-51a777b2df67 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:01.623015 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dbc813ac-e2b7-4dd8-b65f-51a777b2df67 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:01.623533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dbc813ac-e2b7-4dd8-b65f-51a777b2df67 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:01.624614 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dbc813ac-e2b7-4dd8-b65f-51a777b2df67 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:01.626400 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dbc813ac-e2b7-4dd8-b65f-51a777b2df67 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:01.627076 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dbc813ac-e2b7-4dd8-b65f-51a777b2df67 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:01.923797 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-2dfac734-efed-4578-a473-fdc5e36f740a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:01.932423 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-2dfac734-efed-4578-a473-fdc5e36f740a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 200 len: 1317 microversion: 2.1 time: 0.421193 Aug 07 22:40:01.939521 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 139/288] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:01 2022] GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 1317 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:40:01.985483 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ba29ec53-af23-4d20-a437-3eebc86d4624 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:01.986823 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-ba29ec53-af23-4d20-a437-3eebc86d4624 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:02.010049 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ba29ec53-af23-4d20-a437-3eebc86d4624 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:02.010552 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ba29ec53-af23-4d20-a437-3eebc86d4624 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:02.016591 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ba29ec53-af23-4d20-a437-3eebc86d4624 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:02.017315 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ba29ec53-af23-4d20-a437-3eebc86d4624 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:02.017786 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ba29ec53-af23-4d20-a437-3eebc86d4624 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:02.021493 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ba29ec53-af23-4d20-a437-3eebc86d4624 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:02.026388 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-dbc813ac-e2b7-4dd8-b65f-51a777b2df67 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:02.040184 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-dbc813ac-e2b7-4dd8-b65f-51a777b2df67 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1369 microversion: 2.1 time: 0.441071 Aug 07 22:40:02.045272 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 150/289] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:01 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1369 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:40:02.326323 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-ba29ec53-af23-4d20-a437-3eebc86d4624 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:02.339504 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-ba29ec53-af23-4d20-a437-3eebc86d4624 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:02.342347 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-ba29ec53-af23-4d20-a437-3eebc86d4624 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:02.343777 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-ba29ec53-af23-4d20-a437-3eebc86d4624 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1739 microversion: 2.20 time: 0.365799 Aug 07 22:40:02.347163 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 140/290] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:01 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1739 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:02.961353 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-8d4a76cf-9533-4709-9975-1070fd9d555a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:02.961961 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-8d4a76cf-9533-4709-9975-1070fd9d555a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:02.980004 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8d4a76cf-9533-4709-9975-1070fd9d555a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:02.980827 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8d4a76cf-9533-4709-9975-1070fd9d555a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:02.981440 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8d4a76cf-9533-4709-9975-1070fd9d555a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:02.982294 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8d4a76cf-9533-4709-9975-1070fd9d555a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:02.982902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8d4a76cf-9533-4709-9975-1070fd9d555a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:02.983521 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8d4a76cf-9533-4709-9975-1070fd9d555a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:03.066593 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-827f9b4e-988a-40ac-8a82-c84bd4a5c2db tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:03.067167 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-827f9b4e-988a-40ac-8a82-c84bd4a5c2db tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:03.087450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-827f9b4e-988a-40ac-8a82-c84bd4a5c2db tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:03.088063 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-827f9b4e-988a-40ac-8a82-c84bd4a5c2db tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:03.089675 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-827f9b4e-988a-40ac-8a82-c84bd4a5c2db tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:03.090474 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-827f9b4e-988a-40ac-8a82-c84bd4a5c2db tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:03.090963 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-827f9b4e-988a-40ac-8a82-c84bd4a5c2db tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:03.091402 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-827f9b4e-988a-40ac-8a82-c84bd4a5c2db tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:03.225013 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-8d4a76cf-9533-4709-9975-1070fd9d555a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:03.239083 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-8d4a76cf-9533-4709-9975-1070fd9d555a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 200 len: 1317 microversion: 2.1 time: 0.278780 Aug 07 22:40:03.254066 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 151/291] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:02 2022] GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:40:03.302274 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-827f9b4e-988a-40ac-8a82-c84bd4a5c2db tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:03.313634 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-827f9b4e-988a-40ac-8a82-c84bd4a5c2db tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1369 microversion: 2.1 time: 0.251346 Aug 07 22:40:03.320746 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 141/292] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:03 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1369 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:40:03.371840 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-d1a826fe-95fe-45a7-8d4a-eb16674d25a8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:03.373066 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-d1a826fe-95fe-45a7-8d4a-eb16674d25a8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:03.392094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:40:03.394616 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d1a826fe-95fe-45a7-8d4a-eb16674d25a8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:03.395438 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d1a826fe-95fe-45a7-8d4a-eb16674d25a8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:03.395972 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d1a826fe-95fe-45a7-8d4a-eb16674d25a8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:03.396804 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d1a826fe-95fe-45a7-8d4a-eb16674d25a8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:03.398410 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d1a826fe-95fe-45a7-8d4a-eb16674d25a8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:03.398937 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d1a826fe-95fe-45a7-8d4a-eb16674d25a8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:03.596116 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-d1a826fe-95fe-45a7-8d4a-eb16674d25a8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:03.607039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-d1a826fe-95fe-45a7-8d4a-eb16674d25a8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:03.609261 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-d1a826fe-95fe-45a7-8d4a-eb16674d25a8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:03.611083 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-d1a826fe-95fe-45a7-8d4a-eb16674d25a8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1739 microversion: 2.20 time: 0.245648 Aug 07 22:40:03.612455 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 152/293] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:03 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1739 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:03.615713 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-5a5de46b-36df-4c59-aec7-01285b48d3ee req-bacfc6b4-2468-4e13-9357-ca05009052c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f48cf3-8b19-480b-b271-eef00858dbf2", "name": "network-vif-plugged", "status": "completed", "tag": "4b161e96-ab40-40a7-94b4-baefa79fd50f"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:40:03.645720 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-5a5de46b-36df-4c59-aec7-01285b48d3ee req-bacfc6b4-2468-4e13-9357-ca05009052c9 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:03.646330 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-5a5de46b-36df-4c59-aec7-01285b48d3ee req-bacfc6b4-2468-4e13-9357-ca05009052c9 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:03.647195 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-5a5de46b-36df-4c59-aec7-01285b48d3ee req-bacfc6b4-2468-4e13-9357-ca05009052c9 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:03.678714 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-5a5de46b-36df-4c59-aec7-01285b48d3ee req-bacfc6b4-2468-4e13-9357-ca05009052c9 service nova] Creating event network-vif-plugged:4b161e96-ab40-40a7-94b4-baefa79fd50f for instance 24f48cf3-8b19-480b-b271-eef00858dbf2 on hv-cinder-85032 Aug 07 22:40:03.689574 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-5a5de46b-36df-4c59-aec7-01285b48d3ee req-bacfc6b4-2468-4e13-9357-ca05009052c9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074228 Aug 07 22:40:03.689574 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 142/294] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:40:04.264884 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-1a7c15ec-b2e4-409c-bd93-db40cf2c29a2 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:04.267079 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-1a7c15ec-b2e4-409c-bd93-db40cf2c29a2 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:04.303473 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1a7c15ec-b2e4-409c-bd93-db40cf2c29a2 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:04.305022 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1a7c15ec-b2e4-409c-bd93-db40cf2c29a2 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:04.306799 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1a7c15ec-b2e4-409c-bd93-db40cf2c29a2 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:04.311635 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1a7c15ec-b2e4-409c-bd93-db40cf2c29a2 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:04.312359 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1a7c15ec-b2e4-409c-bd93-db40cf2c29a2 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:04.315097 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1a7c15ec-b2e4-409c-bd93-db40cf2c29a2 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:04.342967 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-397fbb5e-6631-4a0a-b119-e27c76b0892b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:04.343956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-397fbb5e-6631-4a0a-b119-e27c76b0892b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:04.372826 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-397fbb5e-6631-4a0a-b119-e27c76b0892b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:04.373737 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-397fbb5e-6631-4a0a-b119-e27c76b0892b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:04.412827 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-397fbb5e-6631-4a0a-b119-e27c76b0892b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:04.412827 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-397fbb5e-6631-4a0a-b119-e27c76b0892b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:04.412827 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-397fbb5e-6631-4a0a-b119-e27c76b0892b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:04.414548 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-397fbb5e-6631-4a0a-b119-e27c76b0892b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:04.860794 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-1a7c15ec-b2e4-409c-bd93-db40cf2c29a2 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:04.871024 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-1a7c15ec-b2e4-409c-bd93-db40cf2c29a2 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 200 len: 1317 microversion: 2.1 time: 0.612086 Aug 07 22:40:04.874600 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 153/295] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:04 2022] GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 1317 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:40:04.884741 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-7e333fc7-0a13-4824-9090-78a28ee4d42e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:04.885355 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-7e333fc7-0a13-4824-9090-78a28ee4d42e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:04.895595 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7e333fc7-0a13-4824-9090-78a28ee4d42e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:04.895595 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7e333fc7-0a13-4824-9090-78a28ee4d42e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:04.895595 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7e333fc7-0a13-4824-9090-78a28ee4d42e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:04.895595 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7e333fc7-0a13-4824-9090-78a28ee4d42e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:04.895978 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7e333fc7-0a13-4824-9090-78a28ee4d42e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:04.896567 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7e333fc7-0a13-4824-9090-78a28ee4d42e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:05.093361 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-397fbb5e-6631-4a0a-b119-e27c76b0892b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:05.109047 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-397fbb5e-6631-4a0a-b119-e27c76b0892b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1369 microversion: 2.1 time: 0.773945 Aug 07 22:40:05.110239 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 143/296] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:04 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1369 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:40:05.212720 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-7e333fc7-0a13-4824-9090-78a28ee4d42e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:05.225145 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-7e333fc7-0a13-4824-9090-78a28ee4d42e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:05.227547 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-7e333fc7-0a13-4824-9090-78a28ee4d42e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:05.228981 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-7e333fc7-0a13-4824-9090-78a28ee4d42e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1739 microversion: 2.20 time: 0.353392 Aug 07 22:40:05.229797 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 154/297] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:04 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1739 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:05.910807 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-c8ce441e-cb97-4c1a-9638-e4fb72a71f5f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:05.912772 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-c8ce441e-cb97-4c1a-9638-e4fb72a71f5f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:05.929221 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c8ce441e-cb97-4c1a-9638-e4fb72a71f5f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:05.931309 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c8ce441e-cb97-4c1a-9638-e4fb72a71f5f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:05.931952 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c8ce441e-cb97-4c1a-9638-e4fb72a71f5f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:05.934892 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c8ce441e-cb97-4c1a-9638-e4fb72a71f5f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:05.935567 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c8ce441e-cb97-4c1a-9638-e4fb72a71f5f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:05.937367 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c8ce441e-cb97-4c1a-9638-e4fb72a71f5f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:06.130572 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-0c83df02-8b0f-43e7-ac0e-8069190d4649 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:06.131805 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-0c83df02-8b0f-43e7-ac0e-8069190d4649 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:06.141143 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0c83df02-8b0f-43e7-ac0e-8069190d4649 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:06.144578 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0c83df02-8b0f-43e7-ac0e-8069190d4649 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:06.145092 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0c83df02-8b0f-43e7-ac0e-8069190d4649 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:06.147856 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0c83df02-8b0f-43e7-ac0e-8069190d4649 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:06.149932 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0c83df02-8b0f-43e7-ac0e-8069190d4649 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:06.151211 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-c8ce441e-cb97-4c1a-9638-e4fb72a71f5f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:06.151935 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0c83df02-8b0f-43e7-ac0e-8069190d4649 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:06.162377 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-c8ce441e-cb97-4c1a-9638-e4fb72a71f5f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 200 len: 1317 microversion: 2.1 time: 0.256078 Aug 07 22:40:06.177215 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 144/298] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:05 2022] GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:40:06.255279 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-295978cb-5b2f-416c-9d71-81179c1a9d21 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:06.256238 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-295978cb-5b2f-416c-9d71-81179c1a9d21 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:06.269165 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-295978cb-5b2f-416c-9d71-81179c1a9d21 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:06.270340 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-295978cb-5b2f-416c-9d71-81179c1a9d21 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:06.270937 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-295978cb-5b2f-416c-9d71-81179c1a9d21 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:06.271805 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-295978cb-5b2f-416c-9d71-81179c1a9d21 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:06.273776 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-295978cb-5b2f-416c-9d71-81179c1a9d21 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:06.275417 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-295978cb-5b2f-416c-9d71-81179c1a9d21 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:06.583287 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-0c83df02-8b0f-43e7-ac0e-8069190d4649 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:06.593247 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-0c83df02-8b0f-43e7-ac0e-8069190d4649 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1563 microversion: 2.1 time: 0.466596 Aug 07 22:40:06.593841 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 155/299] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:06 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1563 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:40:06.623060 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-41221300-4fd6-47d0-a1e8-9e2059390420 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:06.623558 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-41221300-4fd6-47d0-a1e8-9e2059390420 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:06.638952 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-41221300-4fd6-47d0-a1e8-9e2059390420 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:06.643119 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-41221300-4fd6-47d0-a1e8-9e2059390420 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:06.643834 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-41221300-4fd6-47d0-a1e8-9e2059390420 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:06.644771 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-41221300-4fd6-47d0-a1e8-9e2059390420 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:06.645409 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-41221300-4fd6-47d0-a1e8-9e2059390420 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:06.645842 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-41221300-4fd6-47d0-a1e8-9e2059390420 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:06.668128 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=100 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:40:06.704510 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-295978cb-5b2f-416c-9d71-81179c1a9d21 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:06.718492 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-295978cb-5b2f-416c-9d71-81179c1a9d21 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:06.724098 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-295978cb-5b2f-416c-9d71-81179c1a9d21 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:06.727034 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-295978cb-5b2f-416c-9d71-81179c1a9d21 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1739 microversion: 2.20 time: 0.475878 Aug 07 22:40:06.747163 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 145/300] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:06 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1739 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:40:06.801815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-41221300-4fd6-47d0-a1e8-9e2059390420 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.184388 Aug 07 22:40:06.802658 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 156/301] 10.222.0.30 () {58 vars in 1275 bytes} [Sun Aug 7 22:40:06 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa/os-interface => generated 284 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:40:07.193917 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-6db938f3-471d-4aa6-bd86-e4d551f5687a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:07.195006 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-6db938f3-471d-4aa6-bd86-e4d551f5687a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:07.206453 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6db938f3-471d-4aa6-bd86-e4d551f5687a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:07.206991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6db938f3-471d-4aa6-bd86-e4d551f5687a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:07.207448 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6db938f3-471d-4aa6-bd86-e4d551f5687a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:07.213464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6db938f3-471d-4aa6-bd86-e4d551f5687a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:07.214102 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6db938f3-471d-4aa6-bd86-e4d551f5687a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:07.214644 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6db938f3-471d-4aa6-bd86-e4d551f5687a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:07.661871 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-72b563ac-e895-4f57-9ecb-0cf0dbd3e2f6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Action: 'create', calling method: .version_select at 0x7fc09fea80d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-754102463", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhEOFmeIZtDl0Cqv/VAosr9NR0Kyg62GvcxrgbCv90KXjtWwPVD4JlZ5Xne3ZlUTy88EG8thTlNdcJluSiPF82zQRo/+WiNBmcc0K166oagst8zt/11gNByJ0+MsDzVrg=="}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:40:07.679907 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-72b563ac-e895-4f57-9ecb-0cf0dbd3e2f6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Getting quotas for project 6b3cfd456d8748b3a1db990d638340af. Resources: {'key_pairs'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:40:07.685821 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-72b563ac-e895-4f57-9ecb-0cf0dbd3e2f6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Getting quotas for user 394c67bcc3864bb2aca2f4faec834029 and project 6b3cfd456d8748b3a1db990d638340af. Resources: {'key_pairs'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:40:07.777319 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-6db938f3-471d-4aa6-bd86-e4d551f5687a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:07.787780 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-6db938f3-471d-4aa6-bd86-e4d551f5687a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 200 len: 1317 microversion: 2.1 time: 0.602316 Aug 07 22:40:07.793289 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 146/302] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:07 2022] GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 1317 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:40:07.799297 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-900b608e-89fc-42c8-89ea-25c13d003b7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:07.800161 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-900b608e-89fc-42c8-89ea-25c13d003b7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:07.807850 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-900b608e-89fc-42c8-89ea-25c13d003b7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:07.808950 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-900b608e-89fc-42c8-89ea-25c13d003b7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:07.812141 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-900b608e-89fc-42c8-89ea-25c13d003b7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:07.813056 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-900b608e-89fc-42c8-89ea-25c13d003b7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:07.813794 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-900b608e-89fc-42c8-89ea-25c13d003b7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:07.814248 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-900b608e-89fc-42c8-89ea-25c13d003b7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:07.834484 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-72b563ac-e895-4f57-9ecb-0cf0dbd3e2f6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.490384 Aug 07 22:40:07.840916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 157/303] 10.222.0.30 () {60 vars in 1159 bytes} [Sun Aug 7 22:40:07 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:40:08.239612 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-900b608e-89fc-42c8-89ea-25c13d003b7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:08.258688 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-900b608e-89fc-42c8-89ea-25c13d003b7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:08.260820 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-900b608e-89fc-42c8-89ea-25c13d003b7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:08.262233 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-900b608e-89fc-42c8-89ea-25c13d003b7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1739 microversion: 2.20 time: 0.467515 Aug 07 22:40:08.265722 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 147/304] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:07 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1739 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:08.810828 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-1b42e31f-c556-4914-ada8-722112f5f575 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:08.812329 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-1b42e31f-c556-4914-ada8-722112f5f575 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:08.821602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1b42e31f-c556-4914-ada8-722112f5f575 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:08.822235 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1b42e31f-c556-4914-ada8-722112f5f575 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:08.822908 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1b42e31f-c556-4914-ada8-722112f5f575 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:08.823724 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1b42e31f-c556-4914-ada8-722112f5f575 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:08.824325 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1b42e31f-c556-4914-ada8-722112f5f575 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:08.824849 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1b42e31f-c556-4914-ada8-722112f5f575 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:09.266770 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-1b42e31f-c556-4914-ada8-722112f5f575 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:09.276169 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-1b42e31f-c556-4914-ada8-722112f5f575 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 200 len: 1317 microversion: 2.1 time: 0.470009 Aug 07 22:40:09.285988 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-f180c37f-f84c-42a4-8ce1-81d1f07826fb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:09.287297 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-f180c37f-f84c-42a4-8ce1-81d1f07826fb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:09.288578 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 158/305] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:08 2022] GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 1317 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:40:09.295005 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f180c37f-f84c-42a4-8ce1-81d1f07826fb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:09.295512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f180c37f-f84c-42a4-8ce1-81d1f07826fb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:09.296192 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f180c37f-f84c-42a4-8ce1-81d1f07826fb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:09.297075 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f180c37f-f84c-42a4-8ce1-81d1f07826fb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:09.297708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f180c37f-f84c-42a4-8ce1-81d1f07826fb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:09.298340 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f180c37f-f84c-42a4-8ce1-81d1f07826fb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:09.653040 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f180c37f-f84c-42a4-8ce1-81d1f07826fb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:09.665476 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f180c37f-f84c-42a4-8ce1-81d1f07826fb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:09.667619 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f180c37f-f84c-42a4-8ce1-81d1f07826fb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:09.674058 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-f180c37f-f84c-42a4-8ce1-81d1f07826fb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1739 microversion: 2.20 time: 0.389596 Aug 07 22:40:09.674919 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 148/306] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:09 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1739 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:09.698526 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-af8eefc0-fd13-4ff3-869d-3e8ef75a96b1 req-69171d38-4dec-4864-bc49-5de6e255e293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62959a95-0c79-4d83-a375-147271e53ffa", "tag": "ffa75a68-45f7-47ee-941b-97d714ef438e"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:40:09.708993 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-af8eefc0-fd13-4ff3-869d-3e8ef75a96b1 req-69171d38-4dec-4864-bc49-5de6e255e293 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:09.710317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-af8eefc0-fd13-4ff3-869d-3e8ef75a96b1 req-69171d38-4dec-4864-bc49-5de6e255e293 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:09.711323 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-af8eefc0-fd13-4ff3-869d-3e8ef75a96b1 req-69171d38-4dec-4864-bc49-5de6e255e293 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:09.724717 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-af8eefc0-fd13-4ff3-869d-3e8ef75a96b1 req-69171d38-4dec-4864-bc49-5de6e255e293 service nova] Creating event network-changed:ffa75a68-45f7-47ee-941b-97d714ef438e for instance 62959a95-0c79-4d83-a375-147271e53ffa on hv-cinder-85032 Aug 07 22:40:09.732431 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-af8eefc0-fd13-4ff3-869d-3e8ef75a96b1 req-69171d38-4dec-4864-bc49-5de6e255e293 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038466 Aug 07 22:40:09.738909 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 159/307] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:40:10.298332 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-c2b3f118-90a0-406d-b399-5f39f5f459a1 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:10.298960 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-c2b3f118-90a0-406d-b399-5f39f5f459a1 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:10.301978 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:40:10.310429 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c2b3f118-90a0-406d-b399-5f39f5f459a1 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:10.312098 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c2b3f118-90a0-406d-b399-5f39f5f459a1 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:10.314081 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c2b3f118-90a0-406d-b399-5f39f5f459a1 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:10.315116 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c2b3f118-90a0-406d-b399-5f39f5f459a1 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:10.315583 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c2b3f118-90a0-406d-b399-5f39f5f459a1 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:10.316066 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c2b3f118-90a0-406d-b399-5f39f5f459a1 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:10.681617 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-c2b3f118-90a0-406d-b399-5f39f5f459a1 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:10.695967 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-c2b3f118-90a0-406d-b399-5f39f5f459a1 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 200 len: 1505 microversion: 2.1 time: 0.398867 Aug 07 22:40:10.702655 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-bdb77134-1a9b-4efc-8dca-42b814da7eee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:10.703348 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-bdb77134-1a9b-4efc-8dca-42b814da7eee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:10.704479 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 149/308] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:10 2022] GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 1505 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:40:10.712857 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdb77134-1a9b-4efc-8dca-42b814da7eee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:10.713338 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdb77134-1a9b-4efc-8dca-42b814da7eee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:10.714499 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdb77134-1a9b-4efc-8dca-42b814da7eee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:10.715004 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdb77134-1a9b-4efc-8dca-42b814da7eee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:10.715458 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdb77134-1a9b-4efc-8dca-42b814da7eee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:10.715881 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdb77134-1a9b-4efc-8dca-42b814da7eee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:10.962345 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-bdb77134-1a9b-4efc-8dca-42b814da7eee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:10.974815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-bdb77134-1a9b-4efc-8dca-42b814da7eee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:10.975118 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-bdb77134-1a9b-4efc-8dca-42b814da7eee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:10.977374 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-bdb77134-1a9b-4efc-8dca-42b814da7eee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1739 microversion: 2.20 time: 0.278988 Aug 07 22:40:10.989456 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 160/309] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:10 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1739 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:12.005538 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-0f8d0cc7-f9cc-44f1-93f6-b37a5bef3d96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:12.018476 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-0f8d0cc7-f9cc-44f1-93f6-b37a5bef3d96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:12.018476 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0f8d0cc7-f9cc-44f1-93f6-b37a5bef3d96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:12.018476 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0f8d0cc7-f9cc-44f1-93f6-b37a5bef3d96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:12.018476 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0f8d0cc7-f9cc-44f1-93f6-b37a5bef3d96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:12.020865 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0f8d0cc7-f9cc-44f1-93f6-b37a5bef3d96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:12.023510 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0f8d0cc7-f9cc-44f1-93f6-b37a5bef3d96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:12.024000 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0f8d0cc7-f9cc-44f1-93f6-b37a5bef3d96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:12.422426 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-0f8d0cc7-f9cc-44f1-93f6-b37a5bef3d96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:12.451933 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-0f8d0cc7-f9cc-44f1-93f6-b37a5bef3d96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:12.463418 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-0f8d0cc7-f9cc-44f1-93f6-b37a5bef3d96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:12.465467 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-0f8d0cc7-f9cc-44f1-93f6-b37a5bef3d96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1721 microversion: 2.20 time: 0.465800 Aug 07 22:40:12.472414 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 150/310] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:11 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1721 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:13.501906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-8f063b69-19fc-43c4-a2a5-7b4e66a19e43 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:13.502428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-8f063b69-19fc-43c4-a2a5-7b4e66a19e43 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:13.511390 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8f063b69-19fc-43c4-a2a5-7b4e66a19e43 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:13.513729 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8f063b69-19fc-43c4-a2a5-7b4e66a19e43 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:13.513729 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8f063b69-19fc-43c4-a2a5-7b4e66a19e43 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:13.513729 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8f063b69-19fc-43c4-a2a5-7b4e66a19e43 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:13.513729 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8f063b69-19fc-43c4-a2a5-7b4e66a19e43 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:13.514471 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8f063b69-19fc-43c4-a2a5-7b4e66a19e43 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:13.684296 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-8f063b69-19fc-43c4-a2a5-7b4e66a19e43 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:13.702924 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-8f063b69-19fc-43c4-a2a5-7b4e66a19e43 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:13.706479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-8f063b69-19fc-43c4-a2a5-7b4e66a19e43 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:13.710008 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-8f063b69-19fc-43c4-a2a5-7b4e66a19e43 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1721 microversion: 2.20 time: 0.213121 Aug 07 22:40:13.711500 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 161/311] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:13 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:14.737214 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-f510a8ce-ed16-4239-b716-4ed2d6674052 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:14.737955 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-f510a8ce-ed16-4239-b716-4ed2d6674052 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:14.746400 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f510a8ce-ed16-4239-b716-4ed2d6674052 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:14.747231 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f510a8ce-ed16-4239-b716-4ed2d6674052 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:14.747883 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f510a8ce-ed16-4239-b716-4ed2d6674052 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:14.748927 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f510a8ce-ed16-4239-b716-4ed2d6674052 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:14.749599 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f510a8ce-ed16-4239-b716-4ed2d6674052 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:14.750031 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f510a8ce-ed16-4239-b716-4ed2d6674052 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:14.929728 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f510a8ce-ed16-4239-b716-4ed2d6674052 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:14.937892 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f510a8ce-ed16-4239-b716-4ed2d6674052 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:14.939423 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f510a8ce-ed16-4239-b716-4ed2d6674052 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:14.940804 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-f510a8ce-ed16-4239-b716-4ed2d6674052 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1721 microversion: 2.20 time: 0.209526 Aug 07 22:40:14.950095 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 151/312] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:14 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1721 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:15.982743 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-689e51e6-e917-4606-9c87-20af097de657 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:15.990082 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-689e51e6-e917-4606-9c87-20af097de657 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:15.997024 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-689e51e6-e917-4606-9c87-20af097de657 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:15.998459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-689e51e6-e917-4606-9c87-20af097de657 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:15.998459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-689e51e6-e917-4606-9c87-20af097de657 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:15.999597 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-689e51e6-e917-4606-9c87-20af097de657 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:16.000382 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-689e51e6-e917-4606-9c87-20af097de657 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:16.001002 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-689e51e6-e917-4606-9c87-20af097de657 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:16.119838 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-3787d895-ef03-4e4f-9107-00c41b27983e req-57c8ba2e-1a4a-4cbd-aa94-124b723d054e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bda9470-bb0f-45e2-9f1b-e4d1db51aeba", "name": "network-vif-unplugged", "status": "completed", "tag": "1f737453-339e-4e1d-8c0b-b401edea34b1"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:40:16.131477 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-3787d895-ef03-4e4f-9107-00c41b27983e req-57c8ba2e-1a4a-4cbd-aa94-124b723d054e service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:16.132337 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-3787d895-ef03-4e4f-9107-00c41b27983e req-57c8ba2e-1a4a-4cbd-aa94-124b723d054e service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:16.134426 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-3787d895-ef03-4e4f-9107-00c41b27983e req-57c8ba2e-1a4a-4cbd-aa94-124b723d054e service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:16.144915 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-3787d895-ef03-4e4f-9107-00c41b27983e req-57c8ba2e-1a4a-4cbd-aa94-124b723d054e service nova] Creating event network-vif-unplugged:1f737453-339e-4e1d-8c0b-b401edea34b1 for instance 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba on hv-cinder-85032 Aug 07 22:40:16.151664 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-3787d895-ef03-4e4f-9107-00c41b27983e req-57c8ba2e-1a4a-4cbd-aa94-124b723d054e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049282 Aug 07 22:40:16.153740 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 152/313] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:40:16.357692 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-689e51e6-e917-4606-9c87-20af097de657 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:16.369976 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-689e51e6-e917-4606-9c87-20af097de657 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:16.371841 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-689e51e6-e917-4606-9c87-20af097de657 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:16.374851 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-689e51e6-e917-4606-9c87-20af097de657 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1724 microversion: 2.20 time: 0.395969 Aug 07 22:40:16.375881 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 162/314] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:15 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1724 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:16.408192 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-142d73dd-0e09-417d-9c55-80d02ded4604 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f5d1f79-abea-46f6-b0a5-66e8e214d870"}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:40:16.413903 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-142d73dd-0e09-417d-9c55-80d02ded4604 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:16.432686 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-142d73dd-0e09-417d-9c55-80d02ded4604 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:16.432686 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-142d73dd-0e09-417d-9c55-80d02ded4604 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:16.432873 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-142d73dd-0e09-417d-9c55-80d02ded4604 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:16.433539 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-142d73dd-0e09-417d-9c55-80d02ded4604 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:16.434040 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-142d73dd-0e09-417d-9c55-80d02ded4604 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:16.434447 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-142d73dd-0e09-417d-9c55-80d02ded4604 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:17.695457 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-142d73dd-0e09-417d-9c55-80d02ded4604 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "POST /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.300521 Aug 07 22:40:17.697260 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 153/315] 10.222.0.30 () {62 vars in 1364 bytes} [Sun Aug 7 22:40:16 2022] POST /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments => generated 188 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:40:17.853992 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a2885345-0c70-4f0b-bc14-195c3b1d0778 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:40:17.854742 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a2885345-0c70-4f0b-bc14-195c3b1d0778 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:17.856920 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=4 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:40:17.862518 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a2885345-0c70-4f0b-bc14-195c3b1d0778 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:17.863175 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a2885345-0c70-4f0b-bc14-195c3b1d0778 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:17.863684 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a2885345-0c70-4f0b-bc14-195c3b1d0778 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:17.864550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a2885345-0c70-4f0b-bc14-195c3b1d0778 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:17.865075 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a2885345-0c70-4f0b-bc14-195c3b1d0778 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:17.865597 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a2885345-0c70-4f0b-bc14-195c3b1d0778 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:17.924613 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a2885345-0c70-4f0b-bc14-195c3b1d0778 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129964) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 07 22:40:18.254906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a2885345-0c70-4f0b-bc14-195c3b1d0778 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "POST /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/action" status: 202 len: 0 microversion: 2.20 time: 0.407336 Aug 07 22:40:18.255983 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 163/316] 10.222.0.30 () {62 vars in 1319 bytes} [Sun Aug 7 22:40:17 2022] POST /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 22:40:18.268235 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-19e49db7-f207-4a1d-a64c-460914bc2080 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:18.270146 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-19e49db7-f207-4a1d-a64c-460914bc2080 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:18.297385 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-19e49db7-f207-4a1d-a64c-460914bc2080 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:18.304492 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-19e49db7-f207-4a1d-a64c-460914bc2080 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:18.306463 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-19e49db7-f207-4a1d-a64c-460914bc2080 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:18.307464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-19e49db7-f207-4a1d-a64c-460914bc2080 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:18.309957 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-19e49db7-f207-4a1d-a64c-460914bc2080 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:18.310595 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-19e49db7-f207-4a1d-a64c-460914bc2080 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:18.325785 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:40:18.575499 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-19e49db7-f207-4a1d-a64c-460914bc2080 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:18.593202 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-19e49db7-f207-4a1d-a64c-460914bc2080 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:18.599177 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-19e49db7-f207-4a1d-a64c-460914bc2080 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:18.601567 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-19e49db7-f207-4a1d-a64c-460914bc2080 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1810 microversion: 2.20 time: 0.339615 Aug 07 22:40:18.602275 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 154/317] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:18 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1810 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:19.635313 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-c8b53268-c8cc-4520-bbeb-d7f12854e5f6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:19.635925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-c8b53268-c8cc-4520-bbeb-d7f12854e5f6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:19.647625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c8b53268-c8cc-4520-bbeb-d7f12854e5f6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:19.648428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c8b53268-c8cc-4520-bbeb-d7f12854e5f6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:19.649045 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c8b53268-c8cc-4520-bbeb-d7f12854e5f6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:19.649915 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c8b53268-c8cc-4520-bbeb-d7f12854e5f6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:19.652661 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c8b53268-c8cc-4520-bbeb-d7f12854e5f6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:19.653110 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c8b53268-c8cc-4520-bbeb-d7f12854e5f6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:19.837611 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-c8b53268-c8cc-4520-bbeb-d7f12854e5f6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:19.853099 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-c8b53268-c8cc-4520-bbeb-d7f12854e5f6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:19.854709 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-c8b53268-c8cc-4520-bbeb-d7f12854e5f6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:19.856139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-c8b53268-c8cc-4520-bbeb-d7f12854e5f6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1750 microversion: 2.20 time: 0.226241 Aug 07 22:40:19.856994 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 164/318] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:19 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1750 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:20.882886 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-dd6a423b-9a70-44c5-919c-a611f312aa89 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:20.884464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-dd6a423b-9a70-44c5-919c-a611f312aa89 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:20.891560 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-dd6a423b-9a70-44c5-919c-a611f312aa89 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:20.892052 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-dd6a423b-9a70-44c5-919c-a611f312aa89 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:20.892658 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-dd6a423b-9a70-44c5-919c-a611f312aa89 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:20.893227 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-dd6a423b-9a70-44c5-919c-a611f312aa89 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:20.893670 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-dd6a423b-9a70-44c5-919c-a611f312aa89 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:20.894085 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-dd6a423b-9a70-44c5-919c-a611f312aa89 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:21.093628 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-dd6a423b-9a70-44c5-919c-a611f312aa89 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:21.105838 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-dd6a423b-9a70-44c5-919c-a611f312aa89 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:21.107771 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-dd6a423b-9a70-44c5-919c-a611f312aa89 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:21.109089 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-dd6a423b-9a70-44c5-919c-a611f312aa89 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1750 microversion: 2.20 time: 0.232486 Aug 07 22:40:21.109835 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 155/319] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:20 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1750 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:22.134332 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-7dfbf571-ea71-4035-b4c7-6d533d8e402f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:22.135122 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-7dfbf571-ea71-4035-b4c7-6d533d8e402f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:22.141308 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7dfbf571-ea71-4035-b4c7-6d533d8e402f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:22.141939 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7dfbf571-ea71-4035-b4c7-6d533d8e402f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:22.142430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7dfbf571-ea71-4035-b4c7-6d533d8e402f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:22.143539 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7dfbf571-ea71-4035-b4c7-6d533d8e402f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:22.144108 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7dfbf571-ea71-4035-b4c7-6d533d8e402f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:22.144778 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7dfbf571-ea71-4035-b4c7-6d533d8e402f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:22.313274 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-7dfbf571-ea71-4035-b4c7-6d533d8e402f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:22.323513 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-7dfbf571-ea71-4035-b4c7-6d533d8e402f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:22.325096 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-7dfbf571-ea71-4035-b4c7-6d533d8e402f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:22.326461 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-7dfbf571-ea71-4035-b4c7-6d533d8e402f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1750 microversion: 2.20 time: 0.196849 Aug 07 22:40:22.327027 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 165/320] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:22 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1750 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:23.351408 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-f8ac6e6b-09b2-4700-a7a5-700ae363b595 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:23.352216 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-f8ac6e6b-09b2-4700-a7a5-700ae363b595 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:23.364071 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f8ac6e6b-09b2-4700-a7a5-700ae363b595 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:23.364764 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f8ac6e6b-09b2-4700-a7a5-700ae363b595 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:23.365831 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f8ac6e6b-09b2-4700-a7a5-700ae363b595 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:23.368905 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f8ac6e6b-09b2-4700-a7a5-700ae363b595 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:23.369520 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f8ac6e6b-09b2-4700-a7a5-700ae363b595 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:23.374402 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f8ac6e6b-09b2-4700-a7a5-700ae363b595 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:23.687225 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f8ac6e6b-09b2-4700-a7a5-700ae363b595 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:23.708826 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f8ac6e6b-09b2-4700-a7a5-700ae363b595 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:23.713098 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f8ac6e6b-09b2-4700-a7a5-700ae363b595 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:23.716205 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-f8ac6e6b-09b2-4700-a7a5-700ae363b595 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1750 microversion: 2.20 time: 0.369269 Aug 07 22:40:23.728574 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 156/321] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:23 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1750 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:24.745915 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-42a2dd77-ed4f-4cf7-9e7a-a89fb96daa31 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:24.746535 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-42a2dd77-ed4f-4cf7-9e7a-a89fb96daa31 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:24.753201 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-42a2dd77-ed4f-4cf7-9e7a-a89fb96daa31 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:24.753693 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-42a2dd77-ed4f-4cf7-9e7a-a89fb96daa31 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:24.754189 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-42a2dd77-ed4f-4cf7-9e7a-a89fb96daa31 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:24.755013 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-42a2dd77-ed4f-4cf7-9e7a-a89fb96daa31 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:24.755665 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-42a2dd77-ed4f-4cf7-9e7a-a89fb96daa31 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:24.756844 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-42a2dd77-ed4f-4cf7-9e7a-a89fb96daa31 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:25.445712 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-42a2dd77-ed4f-4cf7-9e7a-a89fb96daa31 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:25.459987 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-42a2dd77-ed4f-4cf7-9e7a-a89fb96daa31 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:25.467457 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-42a2dd77-ed4f-4cf7-9e7a-a89fb96daa31 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:25.469464 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-42a2dd77-ed4f-4cf7-9e7a-a89fb96daa31 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1750 microversion: 2.20 time: 0.727746 Aug 07 22:40:25.474142 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 166/322] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:24 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1750 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:26.509663 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-3db0bb99-eb22-4661-b920-1215713a232f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:26.511586 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-3db0bb99-eb22-4661-b920-1215713a232f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:26.521265 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3db0bb99-eb22-4661-b920-1215713a232f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:26.522626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3db0bb99-eb22-4661-b920-1215713a232f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:26.523390 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3db0bb99-eb22-4661-b920-1215713a232f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:26.524442 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3db0bb99-eb22-4661-b920-1215713a232f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:26.525084 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3db0bb99-eb22-4661-b920-1215713a232f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:26.525824 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3db0bb99-eb22-4661-b920-1215713a232f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:26.714295 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-3db0bb99-eb22-4661-b920-1215713a232f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:26.726063 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-3db0bb99-eb22-4661-b920-1215713a232f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:26.728538 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-3db0bb99-eb22-4661-b920-1215713a232f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:26.729306 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-3db0bb99-eb22-4661-b920-1215713a232f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1750 microversion: 2.20 time: 0.236127 Aug 07 22:40:26.730317 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 157/323] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:26 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1750 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:27.753759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-adf6a4a2-8b57-453b-8f09-002536821080 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:27.755005 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-adf6a4a2-8b57-453b-8f09-002536821080 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:27.765379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-adf6a4a2-8b57-453b-8f09-002536821080 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:27.771350 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-adf6a4a2-8b57-453b-8f09-002536821080 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:27.771350 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-adf6a4a2-8b57-453b-8f09-002536821080 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:27.771350 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-adf6a4a2-8b57-453b-8f09-002536821080 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:27.771350 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-adf6a4a2-8b57-453b-8f09-002536821080 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:27.772499 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-adf6a4a2-8b57-453b-8f09-002536821080 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:28.071631 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-adf6a4a2-8b57-453b-8f09-002536821080 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:28.091169 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-adf6a4a2-8b57-453b-8f09-002536821080 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:28.094385 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-adf6a4a2-8b57-453b-8f09-002536821080 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:28.099842 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-adf6a4a2-8b57-453b-8f09-002536821080 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1750 microversion: 2.20 time: 0.347926 Aug 07 22:40:28.104093 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 167/324] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:27 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1750 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:29.126541 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a2dc2284-6e17-421a-8c88-24618346d2eb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:29.127779 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a2dc2284-6e17-421a-8c88-24618346d2eb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:29.136820 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a2dc2284-6e17-421a-8c88-24618346d2eb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:29.141401 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a2dc2284-6e17-421a-8c88-24618346d2eb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:29.141401 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a2dc2284-6e17-421a-8c88-24618346d2eb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:29.141401 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a2dc2284-6e17-421a-8c88-24618346d2eb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:29.141674 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-3252d62a-2d2e-4910-b907-c9aa4f1277b2 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Action: 'create', calling method: .version_select at 0x7fc0ac648ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-742047185", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBuq+j3urkvGzc2upQSCFhzo6ZSBCEs6fse+3onqOp9igKqJlJ06rb16JqkYTjB4IQkN73dqH4NEtqSKPz2c563j4lsrtkxFHAy9sesOuAO1RQAf4PWLE7YJ4z7VKzbYg=="}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:40:29.142113 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a2dc2284-6e17-421a-8c88-24618346d2eb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:29.142113 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a2dc2284-6e17-421a-8c88-24618346d2eb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:29.252275 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-3252d62a-2d2e-4910-b907-c9aa4f1277b2 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Getting quotas for project 097fb8408bfb479d87e7516a93970e61. Resources: {'key_pairs'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:40:29.280958 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-3252d62a-2d2e-4910-b907-c9aa4f1277b2 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Getting quotas for user d7f2dbb97068490d924ae132224dc8ff and project 097fb8408bfb479d87e7516a93970e61. Resources: {'key_pairs'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:40:29.507651 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-3252d62a-2d2e-4910-b907-c9aa4f1277b2 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.570205 Aug 07 22:40:29.509024 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 158/325] 10.222.0.30 () {60 vars in 1159 bytes} [Sun Aug 7 22:40:28 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:40:29.691056 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-a2dc2284-6e17-421a-8c88-24618346d2eb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:29.706385 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-a2dc2284-6e17-421a-8c88-24618346d2eb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:29.715013 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-a2dc2284-6e17-421a-8c88-24618346d2eb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:29.721451 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a2dc2284-6e17-421a-8c88-24618346d2eb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1750 microversion: 2.20 time: 0.596367 Aug 07 22:40:29.727534 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 168/326] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:29 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1750 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:40:30.751684 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-e7d4a765-531b-421b-abd4-44b513de085c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:30.752330 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-e7d4a765-531b-421b-abd4-44b513de085c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:30.761247 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e7d4a765-531b-421b-abd4-44b513de085c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:30.761247 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e7d4a765-531b-421b-abd4-44b513de085c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:30.761597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e7d4a765-531b-421b-abd4-44b513de085c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:30.762303 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e7d4a765-531b-421b-abd4-44b513de085c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:30.762762 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e7d4a765-531b-421b-abd4-44b513de085c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:30.763190 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e7d4a765-531b-421b-abd4-44b513de085c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:30.942245 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-e7d4a765-531b-421b-abd4-44b513de085c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:30.951822 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-e7d4a765-531b-421b-abd4-44b513de085c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:30.953605 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-e7d4a765-531b-421b-abd4-44b513de085c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:30.954766 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-e7d4a765-531b-421b-abd4-44b513de085c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1752 microversion: 2.20 time: 0.207711 Aug 07 22:40:30.955317 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 159/327] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:30 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1752 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:31.986752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-8b37e814-dd4a-4895-8705-7aa716bce54a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:31.987449 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-8b37e814-dd4a-4895-8705-7aa716bce54a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:32.000543 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8b37e814-dd4a-4895-8705-7aa716bce54a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:32.001033 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8b37e814-dd4a-4895-8705-7aa716bce54a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:32.001683 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8b37e814-dd4a-4895-8705-7aa716bce54a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:32.002840 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8b37e814-dd4a-4895-8705-7aa716bce54a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:32.003641 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8b37e814-dd4a-4895-8705-7aa716bce54a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:32.004327 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8b37e814-dd4a-4895-8705-7aa716bce54a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:32.184191 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-8b37e814-dd4a-4895-8705-7aa716bce54a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:32.193933 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-8b37e814-dd4a-4895-8705-7aa716bce54a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:32.195941 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-8b37e814-dd4a-4895-8705-7aa716bce54a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:32.197565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-8b37e814-dd4a-4895-8705-7aa716bce54a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1752 microversion: 2.20 time: 0.223009 Aug 07 22:40:32.218890 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 169/328] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:31 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1752 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:33.243069 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ba6cdbd6-3cac-4716-a890-899ce20a08b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:33.246238 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-ba6cdbd6-3cac-4716-a890-899ce20a08b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:33.257958 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ba6cdbd6-3cac-4716-a890-899ce20a08b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:33.258948 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ba6cdbd6-3cac-4716-a890-899ce20a08b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:33.260080 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ba6cdbd6-3cac-4716-a890-899ce20a08b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:33.261099 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ba6cdbd6-3cac-4716-a890-899ce20a08b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:33.262031 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ba6cdbd6-3cac-4716-a890-899ce20a08b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:33.262736 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ba6cdbd6-3cac-4716-a890-899ce20a08b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:33.496878 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-ba6cdbd6-3cac-4716-a890-899ce20a08b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:33.509575 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-ba6cdbd6-3cac-4716-a890-899ce20a08b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:33.511357 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-ba6cdbd6-3cac-4716-a890-899ce20a08b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:33.513039 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-ba6cdbd6-3cac-4716-a890-899ce20a08b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.274558 Aug 07 22:40:33.513448 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 160/329] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:33 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:34.541851 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-2d4567a9-9975-4981-b419-4bc9dd6bf30c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:34.542462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-2d4567a9-9975-4981-b419-4bc9dd6bf30c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:34.544407 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:40:34.552170 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2d4567a9-9975-4981-b419-4bc9dd6bf30c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:34.552955 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2d4567a9-9975-4981-b419-4bc9dd6bf30c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:34.553437 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2d4567a9-9975-4981-b419-4bc9dd6bf30c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:34.556752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2d4567a9-9975-4981-b419-4bc9dd6bf30c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:34.556752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2d4567a9-9975-4981-b419-4bc9dd6bf30c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:34.556752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2d4567a9-9975-4981-b419-4bc9dd6bf30c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:34.667715 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-0aff4e5e-ca61-4bf3-86bf-699d09171224 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d6dd438-44ee-4945-bbe4-16742d9af7c1", "device": "/dev/sdb"}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:40:34.673669 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-0aff4e5e-ca61-4bf3-86bf-699d09171224 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:34.678787 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0aff4e5e-ca61-4bf3-86bf-699d09171224 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:34.679751 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0aff4e5e-ca61-4bf3-86bf-699d09171224 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:34.680731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0aff4e5e-ca61-4bf3-86bf-699d09171224 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:34.681940 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0aff4e5e-ca61-4bf3-86bf-699d09171224 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:34.682789 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0aff4e5e-ca61-4bf3-86bf-699d09171224 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:34.683524 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0aff4e5e-ca61-4bf3-86bf-699d09171224 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:34.836616 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-2d4567a9-9975-4981-b419-4bc9dd6bf30c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:34.850956 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-2d4567a9-9975-4981-b419-4bc9dd6bf30c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:34.867416 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-2d4567a9-9975-4981-b419-4bc9dd6bf30c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:34.868828 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-2d4567a9-9975-4981-b419-4bc9dd6bf30c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.332495 Aug 07 22:40:34.884666 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 170/330] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:34 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:35.894618 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-817c59d2-65a4-4b91-9572-e9a4e9cd3f90 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:35.895829 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-817c59d2-65a4-4b91-9572-e9a4e9cd3f90 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:35.922261 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-817c59d2-65a4-4b91-9572-e9a4e9cd3f90 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:35.924858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-817c59d2-65a4-4b91-9572-e9a4e9cd3f90 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:35.925818 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-817c59d2-65a4-4b91-9572-e9a4e9cd3f90 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:35.930217 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-817c59d2-65a4-4b91-9572-e9a4e9cd3f90 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:35.931250 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-817c59d2-65a4-4b91-9572-e9a4e9cd3f90 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:35.932200 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-817c59d2-65a4-4b91-9572-e9a4e9cd3f90 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:36.122830 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-817c59d2-65a4-4b91-9572-e9a4e9cd3f90 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:36.131794 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-817c59d2-65a4-4b91-9572-e9a4e9cd3f90 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:36.133355 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-817c59d2-65a4-4b91-9572-e9a4e9cd3f90 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:36.138372 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-817c59d2-65a4-4b91-9572-e9a4e9cd3f90 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.249229 Aug 07 22:40:36.138372 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 171/331] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:35 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:40:37.162617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-374084cc-d41c-485b-bbc3-840cc7e65b7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:37.163462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-374084cc-d41c-485b-bbc3-840cc7e65b7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:37.170192 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-374084cc-d41c-485b-bbc3-840cc7e65b7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:37.170732 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-374084cc-d41c-485b-bbc3-840cc7e65b7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:37.172025 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-374084cc-d41c-485b-bbc3-840cc7e65b7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:37.172783 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-374084cc-d41c-485b-bbc3-840cc7e65b7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:37.173240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-374084cc-d41c-485b-bbc3-840cc7e65b7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:37.173667 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-374084cc-d41c-485b-bbc3-840cc7e65b7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:37.176402 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:40:37.324678 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-374084cc-d41c-485b-bbc3-840cc7e65b7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:37.342197 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-374084cc-d41c-485b-bbc3-840cc7e65b7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:37.348427 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-374084cc-d41c-485b-bbc3-840cc7e65b7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:37.356626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-374084cc-d41c-485b-bbc3-840cc7e65b7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.193555 Aug 07 22:40:37.357505 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 172/332] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:37 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:40:37.713383 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-332ef812-a3d8-4cf7-93dc-0c08b839bee7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1885542665", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-754102463", "security_groups": [{"name": "tempest-secgroup-smoke-1868642240"}], "block_device_mapping_v2": [{"uuid": "8987e5d9-1877-4789-9cfd-bd3647af27bd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aaf0b534-ba14-4766-8d78-28b21425ddb7"}]}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:40:37.850799 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.network.neutron [None req-332ef812-a3d8-4cf7-93dc-0c08b839bee7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] validate_networks() for [('aaf0b534-ba14-4766-8d78-28b21425ddb7', None, None, None, None, None)] {{(pid=129964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 22:40:38.281439 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-332ef812-a3d8-4cf7-93dc-0c08b839bee7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Flavor limits 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 22:40:38.281974 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-332ef812-a3d8-4cf7-93dc-0c08b839bee7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Image limits 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 22:40:38.282317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-332ef812-a3d8-4cf7-93dc-0c08b839bee7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Flavor pref 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 22:40:38.282725 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-332ef812-a3d8-4cf7-93dc-0c08b839bee7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Image pref 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 22:40:38.283133 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-332ef812-a3d8-4cf7-93dc-0c08b839bee7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 22:40:38.302030 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-332ef812-a3d8-4cf7-93dc-0c08b839bee7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:38.302514 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-332ef812-a3d8-4cf7-93dc-0c08b839bee7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:38.303265 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-332ef812-a3d8-4cf7-93dc-0c08b839bee7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:38.304254 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-332ef812-a3d8-4cf7-93dc-0c08b839bee7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:38.304883 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-332ef812-a3d8-4cf7-93dc-0c08b839bee7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:38.305511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-332ef812-a3d8-4cf7-93dc-0c08b839bee7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:38.323726 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-332ef812-a3d8-4cf7-93dc-0c08b839bee7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Getting quotas for project 6b3cfd456d8748b3a1db990d638340af. Resources: {'cores', 'instances', 'ram'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:40:38.327649 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-332ef812-a3d8-4cf7-93dc-0c08b839bee7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Getting quotas for user 394c67bcc3864bb2aca2f4faec834029 and project 6b3cfd456d8748b3a1db990d638340af. Resources: {'cores', 'instances', 'ram'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:40:38.398626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-332ef812-a3d8-4cf7-93dc-0c08b839bee7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Going to run 1 instances... {{(pid=129964) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 22:40:38.400718 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-332ef812-a3d8-4cf7-93dc-0c08b839bee7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8987e5d9-1877-4789-9cfd-bd3647af27bd',volume_size=None,volume_type=None)] {{(pid=129964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 22:40:38.830566 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-332ef812-a3d8-4cf7-93dc-0c08b839bee7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.121598 Aug 07 22:40:38.837630 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 173/333] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 22:40:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 22:40:38.837630 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-d4456a75-6ef6-4287-8347-4fe557b8e7a6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:38.837630 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-d4456a75-6ef6-4287-8347-4fe557b8e7a6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:38.844073 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d4456a75-6ef6-4287-8347-4fe557b8e7a6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:38.844680 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d4456a75-6ef6-4287-8347-4fe557b8e7a6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:38.845211 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d4456a75-6ef6-4287-8347-4fe557b8e7a6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:38.846019 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d4456a75-6ef6-4287-8347-4fe557b8e7a6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:38.846679 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d4456a75-6ef6-4287-8347-4fe557b8e7a6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:38.847231 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d4456a75-6ef6-4287-8347-4fe557b8e7a6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:39.048253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-d4456a75-6ef6-4287-8347-4fe557b8e7a6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:39.061306 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-d4456a75-6ef6-4287-8347-4fe557b8e7a6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:39.070699 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-d4456a75-6ef6-4287-8347-4fe557b8e7a6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:39.074131 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-d4456a75-6ef6-4287-8347-4fe557b8e7a6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.239581 Aug 07 22:40:39.074904 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 174/334] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:38 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:39.085616 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-183fca42-4576-4e01-9971-0c99e3dfadc8 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:39.086364 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-183fca42-4576-4e01-9971-0c99e3dfadc8 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:39.145487 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-183fca42-4576-4e01-9971-0c99e3dfadc8 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:39.152815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-183fca42-4576-4e01-9971-0c99e3dfadc8 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1094 microversion: 2.1 time: 0.071593 Aug 07 22:40:39.167710 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 175/335] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:39 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1094 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:40:39.306590 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=4 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:40:40.098085 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a293f769-1ab0-4ca2-a6d8-3b40df576d96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:40.098736 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a293f769-1ab0-4ca2-a6d8-3b40df576d96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:40.105388 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a293f769-1ab0-4ca2-a6d8-3b40df576d96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:40.105930 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a293f769-1ab0-4ca2-a6d8-3b40df576d96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:40.106303 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a293f769-1ab0-4ca2-a6d8-3b40df576d96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:40.107004 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a293f769-1ab0-4ca2-a6d8-3b40df576d96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:40.107460 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a293f769-1ab0-4ca2-a6d8-3b40df576d96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:40.107873 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a293f769-1ab0-4ca2-a6d8-3b40df576d96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:40.294527 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-a293f769-1ab0-4ca2-a6d8-3b40df576d96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:40.299714 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-a293f769-1ab0-4ca2-a6d8-3b40df576d96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:40.301364 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-a293f769-1ab0-4ca2-a6d8-3b40df576d96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:40.302814 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a293f769-1ab0-4ca2-a6d8-3b40df576d96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.208568 Aug 07 22:40:40.305313 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 176/336] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:40 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:40:40.312552 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-becf27bc-a277-4c90-a782-b83e1d7b93c3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:40.313367 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-becf27bc-a277-4c90-a782-b83e1d7b93c3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:40.381078 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-becf27bc-a277-4c90-a782-b83e1d7b93c3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:40.388377 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-becf27bc-a277-4c90-a782-b83e1d7b93c3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1094 microversion: 2.1 time: 0.081782 Aug 07 22:40:40.389213 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 177/337] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:40 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:40:41.331280 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-0aaf6816-3068-4129-bbd4-6d0386022a7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:41.342262 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-0aaf6816-3068-4129-bbd4-6d0386022a7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:41.353596 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0aaf6816-3068-4129-bbd4-6d0386022a7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:41.354077 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0aaf6816-3068-4129-bbd4-6d0386022a7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:41.354502 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0aaf6816-3068-4129-bbd4-6d0386022a7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:41.355194 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0aaf6816-3068-4129-bbd4-6d0386022a7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:41.355641 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0aaf6816-3068-4129-bbd4-6d0386022a7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:41.356080 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0aaf6816-3068-4129-bbd4-6d0386022a7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:41.495914 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-0aaf6816-3068-4129-bbd4-6d0386022a7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:41.513499 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-0aaf6816-3068-4129-bbd4-6d0386022a7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:41.515011 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-0aaf6816-3068-4129-bbd4-6d0386022a7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:41.516232 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-0aaf6816-3068-4129-bbd4-6d0386022a7d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.189826 Aug 07 22:40:41.517434 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 178/338] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:41 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:40:41.522666 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-835914eb-b7c2-4fea-98d9-0a724c1caad2 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:41.523283 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-835914eb-b7c2-4fea-98d9-0a724c1caad2 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:41.529835 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-835914eb-b7c2-4fea-98d9-0a724c1caad2 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:41.530324 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-835914eb-b7c2-4fea-98d9-0a724c1caad2 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:41.530757 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-835914eb-b7c2-4fea-98d9-0a724c1caad2 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:41.532122 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-835914eb-b7c2-4fea-98d9-0a724c1caad2 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:41.532584 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-835914eb-b7c2-4fea-98d9-0a724c1caad2 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:41.533086 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-835914eb-b7c2-4fea-98d9-0a724c1caad2 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:41.616997 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-835914eb-b7c2-4fea-98d9-0a724c1caad2 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:41.626005 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-835914eb-b7c2-4fea-98d9-0a724c1caad2 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1144 microversion: 2.1 time: 0.107502 Aug 07 22:40:41.626765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 179/339] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:41 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1144 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:40:42.541766 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-24bdade8-9737-438f-9ffe-a8dae9405943 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:42.542479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-24bdade8-9737-438f-9ffe-a8dae9405943 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:42.548352 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-24bdade8-9737-438f-9ffe-a8dae9405943 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:42.548824 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-24bdade8-9737-438f-9ffe-a8dae9405943 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:42.549249 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-24bdade8-9737-438f-9ffe-a8dae9405943 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:42.549919 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-24bdade8-9737-438f-9ffe-a8dae9405943 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:42.550366 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-24bdade8-9737-438f-9ffe-a8dae9405943 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:42.550781 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-24bdade8-9737-438f-9ffe-a8dae9405943 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:42.726982 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-24bdade8-9737-438f-9ffe-a8dae9405943 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:42.738164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-24bdade8-9737-438f-9ffe-a8dae9405943 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:42.740121 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-24bdade8-9737-438f-9ffe-a8dae9405943 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:42.741892 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-24bdade8-9737-438f-9ffe-a8dae9405943 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.203880 Aug 07 22:40:42.762720 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 180/340] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:42 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:40:42.762720 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-6158b33e-5a9c-4838-936d-ce62ca95d18d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:42.762720 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-6158b33e-5a9c-4838-936d-ce62ca95d18d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:42.768804 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6158b33e-5a9c-4838-936d-ce62ca95d18d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:42.769440 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6158b33e-5a9c-4838-936d-ce62ca95d18d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:42.769978 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6158b33e-5a9c-4838-936d-ce62ca95d18d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:42.772121 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6158b33e-5a9c-4838-936d-ce62ca95d18d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:42.772683 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6158b33e-5a9c-4838-936d-ce62ca95d18d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:42.773209 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6158b33e-5a9c-4838-936d-ce62ca95d18d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:42.840516 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-6158b33e-5a9c-4838-936d-ce62ca95d18d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:42.848188 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-6158b33e-5a9c-4838-936d-ce62ca95d18d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1144 microversion: 2.1 time: 0.099508 Aug 07 22:40:42.848980 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 181/341] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:42 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1144 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:40:43.770321 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-bdb0c486-8009-4969-9676-6da386149551 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:43.771618 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-bdb0c486-8009-4969-9676-6da386149551 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:43.777646 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdb0c486-8009-4969-9676-6da386149551 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:43.778160 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdb0c486-8009-4969-9676-6da386149551 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:43.778560 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdb0c486-8009-4969-9676-6da386149551 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:43.779244 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdb0c486-8009-4969-9676-6da386149551 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:43.779698 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdb0c486-8009-4969-9676-6da386149551 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:43.780204 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdb0c486-8009-4969-9676-6da386149551 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:43.919825 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-bdb0c486-8009-4969-9676-6da386149551 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:43.928831 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-bdb0c486-8009-4969-9676-6da386149551 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:43.931996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-bdb0c486-8009-4969-9676-6da386149551 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:43.931996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-bdb0c486-8009-4969-9676-6da386149551 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.165169 Aug 07 22:40:43.936235 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 182/342] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:43 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:40:43.941180 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-9658afff-cbe7-4bf2-92ea-a3fa2f115068 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:43.941973 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-9658afff-cbe7-4bf2-92ea-a3fa2f115068 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:43.948922 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9658afff-cbe7-4bf2-92ea-a3fa2f115068 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:43.949402 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9658afff-cbe7-4bf2-92ea-a3fa2f115068 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:43.949920 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9658afff-cbe7-4bf2-92ea-a3fa2f115068 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:43.951790 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9658afff-cbe7-4bf2-92ea-a3fa2f115068 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:43.952271 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9658afff-cbe7-4bf2-92ea-a3fa2f115068 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:43.954515 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9658afff-cbe7-4bf2-92ea-a3fa2f115068 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:44.013841 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-9658afff-cbe7-4bf2-92ea-a3fa2f115068 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:44.021831 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-9658afff-cbe7-4bf2-92ea-a3fa2f115068 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1144 microversion: 2.1 time: 0.083808 Aug 07 22:40:44.022384 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 183/343] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:43 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:40:44.491613 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-0aff4e5e-ca61-4bf3-86bf-699d09171224 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "POST /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.823709 Aug 07 22:40:44.491613 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 161/344] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 22:40:34 2022] POST /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2/os-volume_attachments => generated 194 bytes in 9826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:40:44.962592 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f71bdf5a-270f-4213-b1fd-82a41b78870a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:44.963121 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f71bdf5a-270f-4213-b1fd-82a41b78870a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:44.971039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f71bdf5a-270f-4213-b1fd-82a41b78870a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:44.971553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f71bdf5a-270f-4213-b1fd-82a41b78870a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:44.971998 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f71bdf5a-270f-4213-b1fd-82a41b78870a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:44.972713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f71bdf5a-270f-4213-b1fd-82a41b78870a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:44.973166 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f71bdf5a-270f-4213-b1fd-82a41b78870a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:44.973583 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f71bdf5a-270f-4213-b1fd-82a41b78870a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:45.044093 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-0df42694-4649-44bf-9861-de198bb64d36 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:45.044709 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-0df42694-4649-44bf-9861-de198bb64d36 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:45.046752 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:40:45.052903 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0df42694-4649-44bf-9861-de198bb64d36 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:45.053787 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0df42694-4649-44bf-9861-de198bb64d36 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:45.053998 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0df42694-4649-44bf-9861-de198bb64d36 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:45.054698 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0df42694-4649-44bf-9861-de198bb64d36 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:45.055146 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0df42694-4649-44bf-9861-de198bb64d36 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:45.055564 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0df42694-4649-44bf-9861-de198bb64d36 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:45.133175 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-0df42694-4649-44bf-9861-de198bb64d36 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:45.136886 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f71bdf5a-270f-4213-b1fd-82a41b78870a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:45.141134 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-0df42694-4649-44bf-9861-de198bb64d36 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1192 microversion: 2.1 time: 0.101682 Aug 07 22:40:45.141713 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 162/345] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:45 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1192 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:40:45.145466 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f71bdf5a-270f-4213-b1fd-82a41b78870a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:45.147620 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f71bdf5a-270f-4213-b1fd-82a41b78870a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:45.148799 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f71bdf5a-270f-4213-b1fd-82a41b78870a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.190444 Aug 07 22:40:45.149392 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 184/346] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:44 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:46.166676 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7138cff1-ae3a-42ca-bb66-917a5b4e3357 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:46.167272 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-7138cff1-ae3a-42ca-bb66-917a5b4e3357 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:46.171986 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-7871b308-eedb-4cd9-ae1a-8427da1407e3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:46.172705 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-7871b308-eedb-4cd9-ae1a-8427da1407e3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:46.174875 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7138cff1-ae3a-42ca-bb66-917a5b4e3357 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:46.175561 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7138cff1-ae3a-42ca-bb66-917a5b4e3357 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:46.176333 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7138cff1-ae3a-42ca-bb66-917a5b4e3357 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:46.177789 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7138cff1-ae3a-42ca-bb66-917a5b4e3357 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:46.178458 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7138cff1-ae3a-42ca-bb66-917a5b4e3357 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:46.179054 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7138cff1-ae3a-42ca-bb66-917a5b4e3357 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:46.180228 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7871b308-eedb-4cd9-ae1a-8427da1407e3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:46.180819 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7871b308-eedb-4cd9-ae1a-8427da1407e3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:46.181314 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7871b308-eedb-4cd9-ae1a-8427da1407e3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:46.182263 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7871b308-eedb-4cd9-ae1a-8427da1407e3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:46.182797 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7871b308-eedb-4cd9-ae1a-8427da1407e3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:46.183340 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7871b308-eedb-4cd9-ae1a-8427da1407e3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:46.465167 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-7871b308-eedb-4cd9-ae1a-8427da1407e3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:46.474317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-7871b308-eedb-4cd9-ae1a-8427da1407e3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:46.475973 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-7871b308-eedb-4cd9-ae1a-8427da1407e3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:46.477254 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-7871b308-eedb-4cd9-ae1a-8427da1407e3 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.309731 Aug 07 22:40:46.477896 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 185/347] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:46 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:46.713882 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7138cff1-ae3a-42ca-bb66-917a5b4e3357 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:46.721404 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-7138cff1-ae3a-42ca-bb66-917a5b4e3357 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1278 microversion: 2.1 time: 0.558824 Aug 07 22:40:46.722058 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 163/348] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:46 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1278 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:40:47.311530 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-f9aa187f-88cc-48c1-8233-a0dbd9874039 req-2519e1bf-d97a-4a5e-9894-6ba5c622c9f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "750b85bc-6bb0-48e2-a912-7664384bcaa0", "tag": "c6e7b289-4e50-424d-9310-ffa0f3386876"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:40:47.321190 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-f9aa187f-88cc-48c1-8233-a0dbd9874039 req-2519e1bf-d97a-4a5e-9894-6ba5c622c9f8 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:47.321855 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-f9aa187f-88cc-48c1-8233-a0dbd9874039 req-2519e1bf-d97a-4a5e-9894-6ba5c622c9f8 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:47.322288 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-f9aa187f-88cc-48c1-8233-a0dbd9874039 req-2519e1bf-d97a-4a5e-9894-6ba5c622c9f8 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:47.334062 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-f9aa187f-88cc-48c1-8233-a0dbd9874039 req-2519e1bf-d97a-4a5e-9894-6ba5c622c9f8 service nova] Creating event network-changed:c6e7b289-4e50-424d-9310-ffa0f3386876 for instance 750b85bc-6bb0-48e2-a912-7664384bcaa0 on hv-cinder-85032 Aug 07 22:40:47.339236 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-f9aa187f-88cc-48c1-8233-a0dbd9874039 req-2519e1bf-d97a-4a5e-9894-6ba5c622c9f8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031673 Aug 07 22:40:47.339844 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 186/349] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:40:47.500592 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-00f1950b-13ae-43c2-8994-1ba8db0e7673 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:47.501204 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-00f1950b-13ae-43c2-8994-1ba8db0e7673 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:47.507798 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-00f1950b-13ae-43c2-8994-1ba8db0e7673 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:47.508308 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-00f1950b-13ae-43c2-8994-1ba8db0e7673 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:47.508747 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-00f1950b-13ae-43c2-8994-1ba8db0e7673 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:47.509721 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-00f1950b-13ae-43c2-8994-1ba8db0e7673 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:47.510361 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-00f1950b-13ae-43c2-8994-1ba8db0e7673 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:47.510790 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-00f1950b-13ae-43c2-8994-1ba8db0e7673 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:47.696615 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-00f1950b-13ae-43c2-8994-1ba8db0e7673 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:47.707519 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-00f1950b-13ae-43c2-8994-1ba8db0e7673 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:47.708834 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-00f1950b-13ae-43c2-8994-1ba8db0e7673 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:47.710023 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-00f1950b-13ae-43c2-8994-1ba8db0e7673 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.213468 Aug 07 22:40:47.710588 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 164/350] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:47 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:47.743889 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-4de84326-45e5-42f7-b16f-92fd8902f47d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:47.744619 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-4de84326-45e5-42f7-b16f-92fd8902f47d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:47.751118 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4de84326-45e5-42f7-b16f-92fd8902f47d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:47.751604 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4de84326-45e5-42f7-b16f-92fd8902f47d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:47.752084 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4de84326-45e5-42f7-b16f-92fd8902f47d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:47.752780 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4de84326-45e5-42f7-b16f-92fd8902f47d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:47.753229 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4de84326-45e5-42f7-b16f-92fd8902f47d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:47.753679 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4de84326-45e5-42f7-b16f-92fd8902f47d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:47.975903 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-4de84326-45e5-42f7-b16f-92fd8902f47d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:47.983916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-4de84326-45e5-42f7-b16f-92fd8902f47d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1278 microversion: 2.1 time: 0.244940 Aug 07 22:40:47.984782 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 187/351] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:47 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1278 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:40:48.735017 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-0aa01a51-0b02-4701-aa93-b31f67ed99a6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:48.735902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-0aa01a51-0b02-4701-aa93-b31f67ed99a6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:48.745538 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0aa01a51-0b02-4701-aa93-b31f67ed99a6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:48.746029 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0aa01a51-0b02-4701-aa93-b31f67ed99a6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:48.746459 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0aa01a51-0b02-4701-aa93-b31f67ed99a6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:48.747293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0aa01a51-0b02-4701-aa93-b31f67ed99a6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:48.748132 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0aa01a51-0b02-4701-aa93-b31f67ed99a6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:48.748903 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0aa01a51-0b02-4701-aa93-b31f67ed99a6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:48.894630 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-0aa01a51-0b02-4701-aa93-b31f67ed99a6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:48.904192 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-0aa01a51-0b02-4701-aa93-b31f67ed99a6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:48.905686 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-0aa01a51-0b02-4701-aa93-b31f67ed99a6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:48.907159 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-0aa01a51-0b02-4701-aa93-b31f67ed99a6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.177343 Aug 07 22:40:48.909096 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 165/352] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:48 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:40:49.005269 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-c9a4bad0-2484-4b8d-aedf-98a04bacf1a8 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:49.006924 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-c9a4bad0-2484-4b8d-aedf-98a04bacf1a8 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:49.012647 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=2 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:40:49.016430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c9a4bad0-2484-4b8d-aedf-98a04bacf1a8 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:49.016430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c9a4bad0-2484-4b8d-aedf-98a04bacf1a8 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:49.016430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c9a4bad0-2484-4b8d-aedf-98a04bacf1a8 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:49.016430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c9a4bad0-2484-4b8d-aedf-98a04bacf1a8 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:49.017028 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c9a4bad0-2484-4b8d-aedf-98a04bacf1a8 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:49.017629 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c9a4bad0-2484-4b8d-aedf-98a04bacf1a8 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:49.171909 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-c9a4bad0-2484-4b8d-aedf-98a04bacf1a8 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:49.179562 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-c9a4bad0-2484-4b8d-aedf-98a04bacf1a8 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1278 microversion: 2.1 time: 0.178153 Aug 07 22:40:49.180148 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 188/353] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:49 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:40:49.932504 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-15926648-1580-481b-8d68-d73b998281ba tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:49.933115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-15926648-1580-481b-8d68-d73b998281ba tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:49.939634 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-15926648-1580-481b-8d68-d73b998281ba tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:49.940159 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-15926648-1580-481b-8d68-d73b998281ba tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:49.940610 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-15926648-1580-481b-8d68-d73b998281ba tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:49.941303 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-15926648-1580-481b-8d68-d73b998281ba tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:49.941761 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-15926648-1580-481b-8d68-d73b998281ba tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:49.942188 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-15926648-1580-481b-8d68-d73b998281ba tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:50.077259 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-15926648-1580-481b-8d68-d73b998281ba tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:50.086623 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-15926648-1580-481b-8d68-d73b998281ba tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:50.088155 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-15926648-1580-481b-8d68-d73b998281ba tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:50.089456 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-15926648-1580-481b-8d68-d73b998281ba tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.160823 Aug 07 22:40:50.089833 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 166/354] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:49 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:50.209839 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-de3feefc-97b3-4149-825a-820459be575a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:50.210488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-de3feefc-97b3-4149-825a-820459be575a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:50.216388 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-de3feefc-97b3-4149-825a-820459be575a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:50.216936 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-de3feefc-97b3-4149-825a-820459be575a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:50.217374 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-de3feefc-97b3-4149-825a-820459be575a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:50.218061 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-de3feefc-97b3-4149-825a-820459be575a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:50.218502 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-de3feefc-97b3-4149-825a-820459be575a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:50.218916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-de3feefc-97b3-4149-825a-820459be575a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:50.357116 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-de3feefc-97b3-4149-825a-820459be575a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:50.366311 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-de3feefc-97b3-4149-825a-820459be575a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1278 microversion: 2.1 time: 0.162710 Aug 07 22:40:50.366978 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 189/355] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:50 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:40:51.111805 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-910af664-aef8-4ed3-b717-c9d62d987647 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:51.112439 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-910af664-aef8-4ed3-b717-c9d62d987647 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:51.119621 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-910af664-aef8-4ed3-b717-c9d62d987647 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:51.120166 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-910af664-aef8-4ed3-b717-c9d62d987647 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:51.120597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-910af664-aef8-4ed3-b717-c9d62d987647 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:51.121274 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-910af664-aef8-4ed3-b717-c9d62d987647 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:51.121718 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-910af664-aef8-4ed3-b717-c9d62d987647 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:51.122139 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-910af664-aef8-4ed3-b717-c9d62d987647 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:51.126224 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:40:51.252268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-910af664-aef8-4ed3-b717-c9d62d987647 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:51.262660 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-910af664-aef8-4ed3-b717-c9d62d987647 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:51.264560 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-910af664-aef8-4ed3-b717-c9d62d987647 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:51.266031 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-910af664-aef8-4ed3-b717-c9d62d987647 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.158169 Aug 07 22:40:51.266788 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 167/356] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:51 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:51.387889 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-2c35900f-e931-42cc-9d64-b415ff79097a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:51.388528 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-2c35900f-e931-42cc-9d64-b415ff79097a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:51.390346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=10 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:40:51.395130 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2c35900f-e931-42cc-9d64-b415ff79097a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:51.395602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2c35900f-e931-42cc-9d64-b415ff79097a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:51.396042 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2c35900f-e931-42cc-9d64-b415ff79097a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:51.396855 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2c35900f-e931-42cc-9d64-b415ff79097a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:51.397300 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2c35900f-e931-42cc-9d64-b415ff79097a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:51.397717 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2c35900f-e931-42cc-9d64-b415ff79097a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:51.534286 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-2c35900f-e931-42cc-9d64-b415ff79097a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:51.542248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-2c35900f-e931-42cc-9d64-b415ff79097a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1278 microversion: 2.1 time: 0.158702 Aug 07 22:40:51.542810 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 190/357] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:51 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:40:52.289776 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-99d6a06f-68e4-4d0e-8fd4-dcfad1bc2007 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:52.290693 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-99d6a06f-68e4-4d0e-8fd4-dcfad1bc2007 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:52.297054 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-99d6a06f-68e4-4d0e-8fd4-dcfad1bc2007 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:52.297523 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-99d6a06f-68e4-4d0e-8fd4-dcfad1bc2007 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:52.297987 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-99d6a06f-68e4-4d0e-8fd4-dcfad1bc2007 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:52.298655 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-99d6a06f-68e4-4d0e-8fd4-dcfad1bc2007 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:52.299099 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-99d6a06f-68e4-4d0e-8fd4-dcfad1bc2007 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:52.299512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-99d6a06f-68e4-4d0e-8fd4-dcfad1bc2007 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:52.427809 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-99d6a06f-68e4-4d0e-8fd4-dcfad1bc2007 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:52.436251 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-99d6a06f-68e4-4d0e-8fd4-dcfad1bc2007 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:52.437747 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-99d6a06f-68e4-4d0e-8fd4-dcfad1bc2007 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:52.438879 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-99d6a06f-68e4-4d0e-8fd4-dcfad1bc2007 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.153035 Aug 07 22:40:52.439433 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 168/358] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:52 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:52.563508 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-36bb2d17-b270-45ec-9f22-b0e120ef13b5 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:52.564140 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-36bb2d17-b270-45ec-9f22-b0e120ef13b5 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:52.570848 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-36bb2d17-b270-45ec-9f22-b0e120ef13b5 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:52.571319 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-36bb2d17-b270-45ec-9f22-b0e120ef13b5 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:52.571748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-36bb2d17-b270-45ec-9f22-b0e120ef13b5 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:52.572460 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-36bb2d17-b270-45ec-9f22-b0e120ef13b5 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:52.572904 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-36bb2d17-b270-45ec-9f22-b0e120ef13b5 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:52.573320 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-36bb2d17-b270-45ec-9f22-b0e120ef13b5 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:52.704418 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-36bb2d17-b270-45ec-9f22-b0e120ef13b5 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:52.712302 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-36bb2d17-b270-45ec-9f22-b0e120ef13b5 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1278 microversion: 2.1 time: 0.152594 Aug 07 22:40:52.712865 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 191/359] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:52 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:40:53.463082 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-016acd63-666d-40b5-b093-9c9b60286e7c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:53.464044 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-016acd63-666d-40b5-b093-9c9b60286e7c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:53.470267 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-016acd63-666d-40b5-b093-9c9b60286e7c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:53.470750 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-016acd63-666d-40b5-b093-9c9b60286e7c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:53.477814 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-016acd63-666d-40b5-b093-9c9b60286e7c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:53.477814 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-016acd63-666d-40b5-b093-9c9b60286e7c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:53.477814 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-016acd63-666d-40b5-b093-9c9b60286e7c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:53.477814 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-016acd63-666d-40b5-b093-9c9b60286e7c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:53.617634 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-016acd63-666d-40b5-b093-9c9b60286e7c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:53.626187 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-016acd63-666d-40b5-b093-9c9b60286e7c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:53.627701 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-016acd63-666d-40b5-b093-9c9b60286e7c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:53.628865 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-016acd63-666d-40b5-b093-9c9b60286e7c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.170619 Aug 07 22:40:53.629422 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 169/360] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:53 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:53.733539 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f51a2330-959e-4014-ac60-e615b75e36a9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:53.734146 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f51a2330-959e-4014-ac60-e615b75e36a9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:53.740182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f51a2330-959e-4014-ac60-e615b75e36a9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:53.740663 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f51a2330-959e-4014-ac60-e615b75e36a9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:53.741096 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f51a2330-959e-4014-ac60-e615b75e36a9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:53.741782 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f51a2330-959e-4014-ac60-e615b75e36a9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:53.742229 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f51a2330-959e-4014-ac60-e615b75e36a9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:53.742649 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f51a2330-959e-4014-ac60-e615b75e36a9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:53.745296 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=100 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:40:53.879345 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f51a2330-959e-4014-ac60-e615b75e36a9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:53.888058 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f51a2330-959e-4014-ac60-e615b75e36a9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1278 microversion: 2.1 time: 0.158508 Aug 07 22:40:53.888777 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 192/361] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:53 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:40:54.652091 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-bbf9090a-999b-4c81-8075-5a06316bb59b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:54.652699 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-bbf9090a-999b-4c81-8075-5a06316bb59b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:54.659391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bbf9090a-999b-4c81-8075-5a06316bb59b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:54.659897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bbf9090a-999b-4c81-8075-5a06316bb59b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:54.660362 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bbf9090a-999b-4c81-8075-5a06316bb59b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:54.661059 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bbf9090a-999b-4c81-8075-5a06316bb59b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:54.662032 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bbf9090a-999b-4c81-8075-5a06316bb59b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:54.662457 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bbf9090a-999b-4c81-8075-5a06316bb59b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:54.795040 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-bbf9090a-999b-4c81-8075-5a06316bb59b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:54.804386 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-bbf9090a-999b-4c81-8075-5a06316bb59b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:54.805818 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-bbf9090a-999b-4c81-8075-5a06316bb59b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:54.806987 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-bbf9090a-999b-4c81-8075-5a06316bb59b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.158922 Aug 07 22:40:54.807586 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 170/362] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:54 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:54.908864 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b12f2f0a-88c1-4313-9258-1ed743678e86 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:54.909812 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-b12f2f0a-88c1-4313-9258-1ed743678e86 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:54.924884 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b12f2f0a-88c1-4313-9258-1ed743678e86 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:54.924884 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b12f2f0a-88c1-4313-9258-1ed743678e86 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:54.924884 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b12f2f0a-88c1-4313-9258-1ed743678e86 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:54.924884 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b12f2f0a-88c1-4313-9258-1ed743678e86 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:54.925248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b12f2f0a-88c1-4313-9258-1ed743678e86 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:54.925248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b12f2f0a-88c1-4313-9258-1ed743678e86 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:55.054948 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-b12f2f0a-88c1-4313-9258-1ed743678e86 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:55.062311 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-b12f2f0a-88c1-4313-9258-1ed743678e86 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1278 microversion: 2.1 time: 0.157425 Aug 07 22:40:55.062944 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 193/363] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:54 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:40:55.830463 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-66ae376d-cb67-41d8-b510-d37de80dc58d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:55.830998 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-66ae376d-cb67-41d8-b510-d37de80dc58d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:55.837606 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-66ae376d-cb67-41d8-b510-d37de80dc58d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:55.838083 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-66ae376d-cb67-41d8-b510-d37de80dc58d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:55.838516 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-66ae376d-cb67-41d8-b510-d37de80dc58d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:55.839198 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-66ae376d-cb67-41d8-b510-d37de80dc58d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:55.839653 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-66ae376d-cb67-41d8-b510-d37de80dc58d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:55.840099 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-66ae376d-cb67-41d8-b510-d37de80dc58d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:55.970516 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-66ae376d-cb67-41d8-b510-d37de80dc58d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:55.981118 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-66ae376d-cb67-41d8-b510-d37de80dc58d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:55.982681 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-66ae376d-cb67-41d8-b510-d37de80dc58d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:55.984117 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-66ae376d-cb67-41d8-b510-d37de80dc58d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.157671 Aug 07 22:40:55.984677 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 171/364] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:55 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:56.083040 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-881a07f3-c08c-4011-96bb-938ab4684fd3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:56.084518 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-881a07f3-c08c-4011-96bb-938ab4684fd3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:56.090058 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-881a07f3-c08c-4011-96bb-938ab4684fd3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:56.090542 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-881a07f3-c08c-4011-96bb-938ab4684fd3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:56.090998 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-881a07f3-c08c-4011-96bb-938ab4684fd3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:56.091716 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-881a07f3-c08c-4011-96bb-938ab4684fd3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:56.092206 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-881a07f3-c08c-4011-96bb-938ab4684fd3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:56.092636 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-881a07f3-c08c-4011-96bb-938ab4684fd3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:56.227909 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-881a07f3-c08c-4011-96bb-938ab4684fd3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:56.235565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-881a07f3-c08c-4011-96bb-938ab4684fd3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1278 microversion: 2.1 time: 0.156435 Aug 07 22:40:56.236155 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 194/365] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:56 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:40:57.006991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-07ae28de-1c78-4f3a-98e4-7d488dcb594f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:57.014738 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-07ae28de-1c78-4f3a-98e4-7d488dcb594f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:57.014738 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-07ae28de-1c78-4f3a-98e4-7d488dcb594f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:57.014738 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-07ae28de-1c78-4f3a-98e4-7d488dcb594f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:57.015172 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-07ae28de-1c78-4f3a-98e4-7d488dcb594f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:57.015790 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-07ae28de-1c78-4f3a-98e4-7d488dcb594f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:57.016267 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-07ae28de-1c78-4f3a-98e4-7d488dcb594f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:57.016683 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-07ae28de-1c78-4f3a-98e4-7d488dcb594f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:57.145013 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-07ae28de-1c78-4f3a-98e4-7d488dcb594f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:57.155413 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-6fb310a0-0790-4c09-b940-1fd160730333 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0058be8-4f43-47bb-beec-e4224e99a5a7"}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:40:57.155907 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-07ae28de-1c78-4f3a-98e4-7d488dcb594f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:57.157185 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-07ae28de-1c78-4f3a-98e4-7d488dcb594f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:57.157918 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-6fb310a0-0790-4c09-b940-1fd160730333 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:57.158415 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-07ae28de-1c78-4f3a-98e4-7d488dcb594f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.155275 Aug 07 22:40:57.159129 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 172/366] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:57 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:57.164497 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6fb310a0-0790-4c09-b940-1fd160730333 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:57.165091 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6fb310a0-0790-4c09-b940-1fd160730333 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:57.165592 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6fb310a0-0790-4c09-b940-1fd160730333 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:57.166347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6fb310a0-0790-4c09-b940-1fd160730333 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:57.166869 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6fb310a0-0790-4c09-b940-1fd160730333 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:57.167357 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6fb310a0-0790-4c09-b940-1fd160730333 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:57.257320 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-9c74c0cd-d8e7-4aa9-bf7f-a63e79e18700 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:57.257931 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-9c74c0cd-d8e7-4aa9-bf7f-a63e79e18700 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:57.264305 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9c74c0cd-d8e7-4aa9-bf7f-a63e79e18700 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:57.264790 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9c74c0cd-d8e7-4aa9-bf7f-a63e79e18700 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:57.265226 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9c74c0cd-d8e7-4aa9-bf7f-a63e79e18700 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:57.265910 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9c74c0cd-d8e7-4aa9-bf7f-a63e79e18700 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:57.266360 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9c74c0cd-d8e7-4aa9-bf7f-a63e79e18700 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:57.266781 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9c74c0cd-d8e7-4aa9-bf7f-a63e79e18700 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:57.401206 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-9c74c0cd-d8e7-4aa9-bf7f-a63e79e18700 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:57.408609 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-9c74c0cd-d8e7-4aa9-bf7f-a63e79e18700 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1278 microversion: 2.1 time: 0.156394 Aug 07 22:40:57.409171 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 173/367] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:57 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:40:58.180970 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-9ac094f2-4b7f-42f7-94d5-f89a60300126 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:58.181590 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-9ac094f2-4b7f-42f7-94d5-f89a60300126 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:58.187905 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9ac094f2-4b7f-42f7-94d5-f89a60300126 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:58.188430 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9ac094f2-4b7f-42f7-94d5-f89a60300126 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:58.190302 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9ac094f2-4b7f-42f7-94d5-f89a60300126 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:58.190302 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9ac094f2-4b7f-42f7-94d5-f89a60300126 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:58.190302 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9ac094f2-4b7f-42f7-94d5-f89a60300126 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:58.190619 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9ac094f2-4b7f-42f7-94d5-f89a60300126 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:58.325364 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-9ac094f2-4b7f-42f7-94d5-f89a60300126 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:58.333843 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-9ac094f2-4b7f-42f7-94d5-f89a60300126 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:58.335349 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-9ac094f2-4b7f-42f7-94d5-f89a60300126 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:58.336655 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-9ac094f2-4b7f-42f7-94d5-f89a60300126 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.159888 Aug 07 22:40:58.337309 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 174/368] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:58 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:40:58.430124 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-52ae2278-0cf8-442d-9071-64cd976f8264 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:58.430828 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-52ae2278-0cf8-442d-9071-64cd976f8264 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:58.436851 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-52ae2278-0cf8-442d-9071-64cd976f8264 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:58.437264 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-52ae2278-0cf8-442d-9071-64cd976f8264 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:58.437699 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-52ae2278-0cf8-442d-9071-64cd976f8264 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:58.438389 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-52ae2278-0cf8-442d-9071-64cd976f8264 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:58.438836 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-52ae2278-0cf8-442d-9071-64cd976f8264 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:58.439259 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-52ae2278-0cf8-442d-9071-64cd976f8264 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:58.447271 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-6fb310a0-0790-4c09-b940-1fd160730333 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "POST /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.295429 Aug 07 22:40:58.449769 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 195/369] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 22:40:57 2022] POST /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa/os-volume_attachments => generated 194 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:40:58.524527 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-be623f8b-1871-4fcf-8db2-4a45861733f7 req-4b468e31-bea9-4ead-8ad3-01a3c1b59dfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bda9470-bb0f-45e2-9f1b-e4d1db51aeba", "name": "network-vif-plugged", "status": "completed", "tag": "1f737453-339e-4e1d-8c0b-b401edea34b1"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:40:58.541934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-be623f8b-1871-4fcf-8db2-4a45861733f7 req-4b468e31-bea9-4ead-8ad3-01a3c1b59dfd service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:58.541934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-be623f8b-1871-4fcf-8db2-4a45861733f7 req-4b468e31-bea9-4ead-8ad3-01a3c1b59dfd service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:58.541934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-be623f8b-1871-4fcf-8db2-4a45861733f7 req-4b468e31-bea9-4ead-8ad3-01a3c1b59dfd service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:58.557607 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-be623f8b-1871-4fcf-8db2-4a45861733f7 req-4b468e31-bea9-4ead-8ad3-01a3c1b59dfd service nova] Creating event network-vif-plugged:1f737453-339e-4e1d-8c0b-b401edea34b1 for instance 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba on hv-cinder-85032 Aug 07 22:40:58.561053 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-be623f8b-1871-4fcf-8db2-4a45861733f7 req-4b468e31-bea9-4ead-8ad3-01a3c1b59dfd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042235 Aug 07 22:40:58.562016 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 196/370] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:40:58.611363 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-52ae2278-0cf8-442d-9071-64cd976f8264 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:58.619118 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-52ae2278-0cf8-442d-9071-64cd976f8264 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1278 microversion: 2.1 time: 0.193334 Aug 07 22:40:58.619693 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 175/371] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:58 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1278 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:40:59.360577 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-adc74d70-7bcd-43ad-a36f-a5a8f2610d99 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:59.361273 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-adc74d70-7bcd-43ad-a36f-a5a8f2610d99 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:59.368668 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-adc74d70-7bcd-43ad-a36f-a5a8f2610d99 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:59.369138 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-adc74d70-7bcd-43ad-a36f-a5a8f2610d99 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:59.369565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-adc74d70-7bcd-43ad-a36f-a5a8f2610d99 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:59.370235 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-adc74d70-7bcd-43ad-a36f-a5a8f2610d99 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:59.370678 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-adc74d70-7bcd-43ad-a36f-a5a8f2610d99 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:59.371089 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-adc74d70-7bcd-43ad-a36f-a5a8f2610d99 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:59.502330 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-adc74d70-7bcd-43ad-a36f-a5a8f2610d99 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:59.511094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-adc74d70-7bcd-43ad-a36f-a5a8f2610d99 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:59.512630 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-adc74d70-7bcd-43ad-a36f-a5a8f2610d99 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:59.513769 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-adc74d70-7bcd-43ad-a36f-a5a8f2610d99 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.157595 Aug 07 22:40:59.514323 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 197/372] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:40:59 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:40:59.641083 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-246ad367-4e65-4d86-86fe-6cb485ece70c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:40:59.641604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-246ad367-4e65-4d86-86fe-6cb485ece70c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:40:59.649063 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-246ad367-4e65-4d86-86fe-6cb485ece70c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:59.649608 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-246ad367-4e65-4d86-86fe-6cb485ece70c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:59.650046 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-246ad367-4e65-4d86-86fe-6cb485ece70c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:59.650729 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-246ad367-4e65-4d86-86fe-6cb485ece70c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:40:59.651182 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-246ad367-4e65-4d86-86fe-6cb485ece70c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:40:59.651600 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-246ad367-4e65-4d86-86fe-6cb485ece70c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:40:59.785363 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-246ad367-4e65-4d86-86fe-6cb485ece70c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:40:59.792686 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-246ad367-4e65-4d86-86fe-6cb485ece70c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1278 microversion: 2.1 time: 0.155598 Aug 07 22:40:59.793247 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 176/373] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:40:59 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:00.537164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-4759fc0f-a355-4e80-bb6b-4b652ad9ff79 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:00.538063 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-4759fc0f-a355-4e80-bb6b-4b652ad9ff79 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:00.545133 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4759fc0f-a355-4e80-bb6b-4b652ad9ff79 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:00.545607 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4759fc0f-a355-4e80-bb6b-4b652ad9ff79 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:00.546040 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4759fc0f-a355-4e80-bb6b-4b652ad9ff79 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:00.546723 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4759fc0f-a355-4e80-bb6b-4b652ad9ff79 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:00.547194 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4759fc0f-a355-4e80-bb6b-4b652ad9ff79 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:00.547615 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4759fc0f-a355-4e80-bb6b-4b652ad9ff79 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:00.679795 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-4759fc0f-a355-4e80-bb6b-4b652ad9ff79 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:00.688143 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-4759fc0f-a355-4e80-bb6b-4b652ad9ff79 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:00.689625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-4759fc0f-a355-4e80-bb6b-4b652ad9ff79 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:00.690758 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-4759fc0f-a355-4e80-bb6b-4b652ad9ff79 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.158223 Aug 07 22:41:00.691302 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 198/374] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:41:00 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:41:00.812150 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-f67fa1c6-67d3-4db5-9919-361d70bd42ca tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:00.812761 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-f67fa1c6-67d3-4db5-9919-361d70bd42ca tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:00.819183 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f67fa1c6-67d3-4db5-9919-361d70bd42ca tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:00.819661 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f67fa1c6-67d3-4db5-9919-361d70bd42ca tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:00.820124 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f67fa1c6-67d3-4db5-9919-361d70bd42ca tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:00.820809 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f67fa1c6-67d3-4db5-9919-361d70bd42ca tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:00.821261 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f67fa1c6-67d3-4db5-9919-361d70bd42ca tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:00.821688 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f67fa1c6-67d3-4db5-9919-361d70bd42ca tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:00.953389 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f67fa1c6-67d3-4db5-9919-361d70bd42ca tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:00.961374 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-f67fa1c6-67d3-4db5-9919-361d70bd42ca tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1278 microversion: 2.1 time: 0.153044 Aug 07 22:41:00.961933 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 177/375] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:00 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:01.712965 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-bb68237b-e122-4b8a-9e58-e66e52cad952 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:01.713572 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-bb68237b-e122-4b8a-9e58-e66e52cad952 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:01.719897 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bb68237b-e122-4b8a-9e58-e66e52cad952 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:01.720399 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bb68237b-e122-4b8a-9e58-e66e52cad952 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:01.720833 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bb68237b-e122-4b8a-9e58-e66e52cad952 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:01.721505 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bb68237b-e122-4b8a-9e58-e66e52cad952 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:01.721948 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bb68237b-e122-4b8a-9e58-e66e52cad952 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:01.722362 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bb68237b-e122-4b8a-9e58-e66e52cad952 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:01.851335 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-bb68237b-e122-4b8a-9e58-e66e52cad952 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:01.859610 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-bb68237b-e122-4b8a-9e58-e66e52cad952 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:01.861142 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-bb68237b-e122-4b8a-9e58-e66e52cad952 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:01.862292 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-bb68237b-e122-4b8a-9e58-e66e52cad952 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.153160 Aug 07 22:41:01.862839 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 199/376] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:41:01 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:41:01.982430 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-fc592f4f-e56c-4e70-9f27-b5ff7073082d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:01.985416 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-fc592f4f-e56c-4e70-9f27-b5ff7073082d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:01.990063 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fc592f4f-e56c-4e70-9f27-b5ff7073082d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:01.990542 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fc592f4f-e56c-4e70-9f27-b5ff7073082d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:01.990984 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fc592f4f-e56c-4e70-9f27-b5ff7073082d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:01.991655 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fc592f4f-e56c-4e70-9f27-b5ff7073082d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:01.992134 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fc592f4f-e56c-4e70-9f27-b5ff7073082d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:01.992554 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fc592f4f-e56c-4e70-9f27-b5ff7073082d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:02.125811 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-fc592f4f-e56c-4e70-9f27-b5ff7073082d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:02.132733 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-fc592f4f-e56c-4e70-9f27-b5ff7073082d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1278 microversion: 2.1 time: 0.154143 Aug 07 22:41:02.133292 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 178/377] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:01 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:02.885951 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-66a616b8-7112-41b7-90f7-92d7c58c3639 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:02.886471 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-66a616b8-7112-41b7-90f7-92d7c58c3639 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:02.892901 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-66a616b8-7112-41b7-90f7-92d7c58c3639 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:02.893376 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-66a616b8-7112-41b7-90f7-92d7c58c3639 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:02.893806 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-66a616b8-7112-41b7-90f7-92d7c58c3639 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:02.894488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-66a616b8-7112-41b7-90f7-92d7c58c3639 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:02.894936 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-66a616b8-7112-41b7-90f7-92d7c58c3639 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:02.895356 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-66a616b8-7112-41b7-90f7-92d7c58c3639 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:03.028314 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-66a616b8-7112-41b7-90f7-92d7c58c3639 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:03.036909 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-66a616b8-7112-41b7-90f7-92d7c58c3639 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:03.038741 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-66a616b8-7112-41b7-90f7-92d7c58c3639 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:03.039868 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-66a616b8-7112-41b7-90f7-92d7c58c3639 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.158321 Aug 07 22:41:03.040659 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 200/378] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:41:02 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:41:03.154849 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-1aca5ef1-0a9c-44c5-8535-862068275576 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:03.154849 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-1aca5ef1-0a9c-44c5-8535-862068275576 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:03.160345 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1aca5ef1-0a9c-44c5-8535-862068275576 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:03.160838 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1aca5ef1-0a9c-44c5-8535-862068275576 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:03.161248 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1aca5ef1-0a9c-44c5-8535-862068275576 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:03.161930 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1aca5ef1-0a9c-44c5-8535-862068275576 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:03.162375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1aca5ef1-0a9c-44c5-8535-862068275576 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:03.162791 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1aca5ef1-0a9c-44c5-8535-862068275576 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:03.290633 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-1aca5ef1-0a9c-44c5-8535-862068275576 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:03.298462 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-1aca5ef1-0a9c-44c5-8535-862068275576 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1278 microversion: 2.1 time: 0.149610 Aug 07 22:41:03.299024 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 179/379] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:03 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1278 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:04.062768 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-aff7d32d-1d3e-4253-90ce-0cada4f23cfc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:04.063383 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-aff7d32d-1d3e-4253-90ce-0cada4f23cfc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:04.070051 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-aff7d32d-1d3e-4253-90ce-0cada4f23cfc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:04.070522 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-aff7d32d-1d3e-4253-90ce-0cada4f23cfc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:04.070951 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-aff7d32d-1d3e-4253-90ce-0cada4f23cfc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:04.071629 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-aff7d32d-1d3e-4253-90ce-0cada4f23cfc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:04.072094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-aff7d32d-1d3e-4253-90ce-0cada4f23cfc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:04.072518 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-aff7d32d-1d3e-4253-90ce-0cada4f23cfc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:04.214870 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-aff7d32d-1d3e-4253-90ce-0cada4f23cfc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:04.223309 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-aff7d32d-1d3e-4253-90ce-0cada4f23cfc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:04.225735 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-aff7d32d-1d3e-4253-90ce-0cada4f23cfc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:04.226821 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-aff7d32d-1d3e-4253-90ce-0cada4f23cfc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.168074 Aug 07 22:41:04.227448 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 201/380] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:41:04 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:41:04.319395 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-8711f3ab-eb81-490c-a00b-4d5b483939e9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:04.320129 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-8711f3ab-eb81-490c-a00b-4d5b483939e9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:04.326907 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8711f3ab-eb81-490c-a00b-4d5b483939e9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:04.327425 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8711f3ab-eb81-490c-a00b-4d5b483939e9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:04.327881 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8711f3ab-eb81-490c-a00b-4d5b483939e9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:04.328624 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8711f3ab-eb81-490c-a00b-4d5b483939e9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:04.329082 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8711f3ab-eb81-490c-a00b-4d5b483939e9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:04.329565 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8711f3ab-eb81-490c-a00b-4d5b483939e9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:04.472511 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8711f3ab-eb81-490c-a00b-4d5b483939e9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:04.476257 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-8711f3ab-eb81-490c-a00b-4d5b483939e9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1278 microversion: 2.1 time: 0.161276 Aug 07 22:41:04.476829 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 180/381] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:04 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:05.249253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f18ae2e1-ecef-4849-9c20-07c64f4744fe tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:05.249847 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f18ae2e1-ecef-4849-9c20-07c64f4744fe tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:05.252288 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:05.257449 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f18ae2e1-ecef-4849-9c20-07c64f4744fe tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:05.257919 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f18ae2e1-ecef-4849-9c20-07c64f4744fe tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:05.258352 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f18ae2e1-ecef-4849-9c20-07c64f4744fe tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:05.259027 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f18ae2e1-ecef-4849-9c20-07c64f4744fe tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:05.259741 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f18ae2e1-ecef-4849-9c20-07c64f4744fe tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:05.260190 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f18ae2e1-ecef-4849-9c20-07c64f4744fe tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:05.392804 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f18ae2e1-ecef-4849-9c20-07c64f4744fe tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:05.402402 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f18ae2e1-ecef-4849-9c20-07c64f4744fe tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:05.404045 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f18ae2e1-ecef-4849-9c20-07c64f4744fe tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:05.405103 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f18ae2e1-ecef-4849-9c20-07c64f4744fe tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.160343 Aug 07 22:41:05.405693 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 202/382] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:41:05 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:41:05.497274 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-254aeaaf-7bda-40bb-ae18-fa3609bfed3f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:05.498298 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-254aeaaf-7bda-40bb-ae18-fa3609bfed3f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:05.505201 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-254aeaaf-7bda-40bb-ae18-fa3609bfed3f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:05.505678 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-254aeaaf-7bda-40bb-ae18-fa3609bfed3f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:05.506121 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-254aeaaf-7bda-40bb-ae18-fa3609bfed3f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:05.506895 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-254aeaaf-7bda-40bb-ae18-fa3609bfed3f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:05.507237 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-254aeaaf-7bda-40bb-ae18-fa3609bfed3f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:05.507653 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-254aeaaf-7bda-40bb-ae18-fa3609bfed3f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:05.655439 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-254aeaaf-7bda-40bb-ae18-fa3609bfed3f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:05.662976 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-254aeaaf-7bda-40bb-ae18-fa3609bfed3f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1278 microversion: 2.1 time: 0.169503 Aug 07 22:41:05.663545 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 181/383] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:05 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:06.430633 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-e3e73176-1929-4ac1-80fe-c6f305af4584 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:06.431156 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-e3e73176-1929-4ac1-80fe-c6f305af4584 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:06.437567 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e3e73176-1929-4ac1-80fe-c6f305af4584 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:06.438045 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e3e73176-1929-4ac1-80fe-c6f305af4584 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:06.438479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e3e73176-1929-4ac1-80fe-c6f305af4584 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:06.439254 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e3e73176-1929-4ac1-80fe-c6f305af4584 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:06.439722 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e3e73176-1929-4ac1-80fe-c6f305af4584 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:06.440230 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e3e73176-1929-4ac1-80fe-c6f305af4584 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:06.571214 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-e3e73176-1929-4ac1-80fe-c6f305af4584 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:06.579683 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-e3e73176-1929-4ac1-80fe-c6f305af4584 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:06.581356 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-e3e73176-1929-4ac1-80fe-c6f305af4584 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:06.582541 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-e3e73176-1929-4ac1-80fe-c6f305af4584 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.156662 Aug 07 22:41:06.583093 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 203/384] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:41:06 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:41:06.684405 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-51c618aa-868d-478d-85e2-824f433d2fb0 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:06.684943 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-51c618aa-868d-478d-85e2-824f433d2fb0 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:06.691280 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-51c618aa-868d-478d-85e2-824f433d2fb0 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:06.691761 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-51c618aa-868d-478d-85e2-824f433d2fb0 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:06.692234 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-51c618aa-868d-478d-85e2-824f433d2fb0 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:06.692927 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-51c618aa-868d-478d-85e2-824f433d2fb0 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:06.693416 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-51c618aa-868d-478d-85e2-824f433d2fb0 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:06.693937 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-51c618aa-868d-478d-85e2-824f433d2fb0 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:06.827625 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-51c618aa-868d-478d-85e2-824f433d2fb0 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:06.835617 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-51c618aa-868d-478d-85e2-824f433d2fb0 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1278 microversion: 2.1 time: 0.155120 Aug 07 22:41:06.836205 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 182/385] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:06 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:07.605698 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-6a299685-f0e6-412a-93e1-e2e6d66b8b4b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:07.606339 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-6a299685-f0e6-412a-93e1-e2e6d66b8b4b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:07.612896 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6a299685-f0e6-412a-93e1-e2e6d66b8b4b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:07.613374 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6a299685-f0e6-412a-93e1-e2e6d66b8b4b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:07.613812 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6a299685-f0e6-412a-93e1-e2e6d66b8b4b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:07.614498 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6a299685-f0e6-412a-93e1-e2e6d66b8b4b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:07.614950 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6a299685-f0e6-412a-93e1-e2e6d66b8b4b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:07.615451 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6a299685-f0e6-412a-93e1-e2e6d66b8b4b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:07.743060 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-6a299685-f0e6-412a-93e1-e2e6d66b8b4b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:07.751642 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-6a299685-f0e6-412a-93e1-e2e6d66b8b4b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:07.753179 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-6a299685-f0e6-412a-93e1-e2e6d66b8b4b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:07.754460 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-6a299685-f0e6-412a-93e1-e2e6d66b8b4b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1808 microversion: 2.20 time: 0.152658 Aug 07 22:41:07.755021 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 204/386] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:41:07 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:41:07.856873 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-38ff6312-10a0-4ab9-b5d1-c925cb61dac3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:07.857479 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-38ff6312-10a0-4ab9-b5d1-c925cb61dac3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:07.863918 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-38ff6312-10a0-4ab9-b5d1-c925cb61dac3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:07.864421 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-38ff6312-10a0-4ab9-b5d1-c925cb61dac3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:07.864849 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-38ff6312-10a0-4ab9-b5d1-c925cb61dac3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:07.865633 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-38ff6312-10a0-4ab9-b5d1-c925cb61dac3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:07.866076 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-38ff6312-10a0-4ab9-b5d1-c925cb61dac3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:07.866492 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-38ff6312-10a0-4ab9-b5d1-c925cb61dac3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:08.001736 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-38ff6312-10a0-4ab9-b5d1-c925cb61dac3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:08.003942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=100 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:08.011085 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-38ff6312-10a0-4ab9-b5d1-c925cb61dac3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1278 microversion: 2.1 time: 0.157923 Aug 07 22:41:08.018351 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 183/387] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:07 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:08.777683 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-d790b95c-fadf-4432-9ae5-4998f9dafba8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:08.778293 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-d790b95c-fadf-4432-9ae5-4998f9dafba8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:08.784592 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d790b95c-fadf-4432-9ae5-4998f9dafba8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:08.785065 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d790b95c-fadf-4432-9ae5-4998f9dafba8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:08.785498 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d790b95c-fadf-4432-9ae5-4998f9dafba8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:08.786180 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d790b95c-fadf-4432-9ae5-4998f9dafba8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:08.786625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d790b95c-fadf-4432-9ae5-4998f9dafba8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:08.787044 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d790b95c-fadf-4432-9ae5-4998f9dafba8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:08.920312 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-d790b95c-fadf-4432-9ae5-4998f9dafba8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:08.927612 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-d790b95c-fadf-4432-9ae5-4998f9dafba8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:08.930026 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-d790b95c-fadf-4432-9ae5-4998f9dafba8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:08.931170 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-d790b95c-fadf-4432-9ae5-4998f9dafba8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1795 microversion: 2.20 time: 0.157472 Aug 07 22:41:08.931734 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 205/388] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:41:08 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1795 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:41:09.032924 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-9ffebb8a-af30-4d93-bb7e-681fae64a9ac tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:09.033529 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-9ffebb8a-af30-4d93-bb7e-681fae64a9ac tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:09.041356 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9ffebb8a-af30-4d93-bb7e-681fae64a9ac tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:09.041835 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9ffebb8a-af30-4d93-bb7e-681fae64a9ac tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:09.042263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9ffebb8a-af30-4d93-bb7e-681fae64a9ac tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:09.042949 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9ffebb8a-af30-4d93-bb7e-681fae64a9ac tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:09.043395 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9ffebb8a-af30-4d93-bb7e-681fae64a9ac tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:09.043813 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9ffebb8a-af30-4d93-bb7e-681fae64a9ac tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:09.175248 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-9ffebb8a-af30-4d93-bb7e-681fae64a9ac tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:09.182956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-9ffebb8a-af30-4d93-bb7e-681fae64a9ac tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1266 microversion: 2.1 time: 0.153921 Aug 07 22:41:09.183571 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 184/389] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:09 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:10.205017 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-d8a89c70-c7f5-4201-9c52-b8151b7f5709 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:10.205568 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-d8a89c70-c7f5-4201-9c52-b8151b7f5709 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:10.212129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d8a89c70-c7f5-4201-9c52-b8151b7f5709 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:10.212551 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d8a89c70-c7f5-4201-9c52-b8151b7f5709 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:10.213157 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d8a89c70-c7f5-4201-9c52-b8151b7f5709 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:10.213881 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d8a89c70-c7f5-4201-9c52-b8151b7f5709 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:10.214327 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d8a89c70-c7f5-4201-9c52-b8151b7f5709 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:10.214744 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d8a89c70-c7f5-4201-9c52-b8151b7f5709 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:10.348912 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-d8a89c70-c7f5-4201-9c52-b8151b7f5709 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:10.356895 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-d8a89c70-c7f5-4201-9c52-b8151b7f5709 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1266 microversion: 2.1 time: 0.155836 Aug 07 22:41:10.357453 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 206/390] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:10 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:11.046465 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-686fe9e5-63bc-47f3-984e-5f426ae03460 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1048491040", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-742047185", "security_groups": [{"name": "tempest-secgroup-smoke-2007256911"}], "networks": [{"uuid": "ff3d91e3-3731-4cfe-8faa-1401bf7138bd"}], "block_device_mapping_v2": [{"uuid": "6ad32d28-ba42-448f-bfe9-c2eee776bd99", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:41:11.158480 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.network.neutron [None req-686fe9e5-63bc-47f3-984e-5f426ae03460 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] validate_networks() for [('ff3d91e3-3731-4cfe-8faa-1401bf7138bd', None, None, None, None, None)] {{(pid=129965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 22:41:11.378973 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-c7c712d5-34e8-4b87-96b9-a793789ec785 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:11.379517 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-c7c712d5-34e8-4b87-96b9-a793789ec785 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:11.387473 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c7c712d5-34e8-4b87-96b9-a793789ec785 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:11.388113 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c7c712d5-34e8-4b87-96b9-a793789ec785 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:11.388550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c7c712d5-34e8-4b87-96b9-a793789ec785 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:11.389248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c7c712d5-34e8-4b87-96b9-a793789ec785 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:11.389715 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c7c712d5-34e8-4b87-96b9-a793789ec785 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:11.390114 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c7c712d5-34e8-4b87-96b9-a793789ec785 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:11.593028 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-c7c712d5-34e8-4b87-96b9-a793789ec785 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:11.594697 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-686fe9e5-63bc-47f3-984e-5f426ae03460 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Flavor limits 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 22:41:11.595121 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-686fe9e5-63bc-47f3-984e-5f426ae03460 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Image limits 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 22:41:11.595590 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-686fe9e5-63bc-47f3-984e-5f426ae03460 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Flavor pref 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 22:41:11.595996 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-686fe9e5-63bc-47f3-984e-5f426ae03460 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Image pref 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 22:41:11.596653 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-686fe9e5-63bc-47f3-984e-5f426ae03460 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 22:41:11.600530 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-c7c712d5-34e8-4b87-96b9-a793789ec785 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1266 microversion: 2.1 time: 0.225553 Aug 07 22:41:11.601091 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 207/391] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:11 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:41:11.605666 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-686fe9e5-63bc-47f3-984e-5f426ae03460 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:11.606141 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-686fe9e5-63bc-47f3-984e-5f426ae03460 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:11.606606 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-686fe9e5-63bc-47f3-984e-5f426ae03460 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:11.607324 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-686fe9e5-63bc-47f3-984e-5f426ae03460 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:11.607778 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-686fe9e5-63bc-47f3-984e-5f426ae03460 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:11.608227 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-686fe9e5-63bc-47f3-984e-5f426ae03460 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:11.625182 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-686fe9e5-63bc-47f3-984e-5f426ae03460 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Getting quotas for project 097fb8408bfb479d87e7516a93970e61. Resources: {'cores', 'instances', 'ram'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:41:11.629159 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-686fe9e5-63bc-47f3-984e-5f426ae03460 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Getting quotas for user d7f2dbb97068490d924ae132224dc8ff and project 097fb8408bfb479d87e7516a93970e61. Resources: {'cores', 'instances', 'ram'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:41:11.685935 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-686fe9e5-63bc-47f3-984e-5f426ae03460 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Going to run 1 instances... {{(pid=129965) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 22:41:11.688045 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-686fe9e5-63bc-47f3-984e-5f426ae03460 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6ad32d28-ba42-448f-bfe9-c2eee776bd99',volume_size=None,volume_type=None)] {{(pid=129965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 22:41:12.118959 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-686fe9e5-63bc-47f3-984e-5f426ae03460 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.076345 Aug 07 22:41:12.119634 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 185/392] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 22:41:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 22:41:12.131026 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-51f5e73b-b5c7-4e4e-b405-ac37cca46e8c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:12.131841 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-51f5e73b-b5c7-4e4e-b405-ac37cca46e8c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:12.203385 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-51f5e73b-b5c7-4e4e-b405-ac37cca46e8c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:12.211563 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-51f5e73b-b5c7-4e4e-b405-ac37cca46e8c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1088 microversion: 2.1 time: 0.084497 Aug 07 22:41:12.213377 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 208/393] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:12 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1088 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:12.621103 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d78c13da-a02c-43dd-a7fd-4d1fe60e32ec tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:12.621708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-d78c13da-a02c-43dd-a7fd-4d1fe60e32ec tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:12.628285 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d78c13da-a02c-43dd-a7fd-4d1fe60e32ec tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:12.628756 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d78c13da-a02c-43dd-a7fd-4d1fe60e32ec tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:12.629183 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d78c13da-a02c-43dd-a7fd-4d1fe60e32ec tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:12.629853 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d78c13da-a02c-43dd-a7fd-4d1fe60e32ec tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:12.630294 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d78c13da-a02c-43dd-a7fd-4d1fe60e32ec tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:12.631190 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d78c13da-a02c-43dd-a7fd-4d1fe60e32ec tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:12.759247 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-d78c13da-a02c-43dd-a7fd-4d1fe60e32ec tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:12.767307 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-d78c13da-a02c-43dd-a7fd-4d1fe60e32ec tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1266 microversion: 2.1 time: 0.150044 Aug 07 22:41:12.767872 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 186/394] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:12 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:13.234054 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f687fede-2778-4988-a6e9-e897ebe041d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:13.234661 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f687fede-2778-4988-a6e9-e897ebe041d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:13.241692 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f687fede-2778-4988-a6e9-e897ebe041d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:13.242168 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f687fede-2778-4988-a6e9-e897ebe041d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:13.242599 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f687fede-2778-4988-a6e9-e897ebe041d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:13.243280 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f687fede-2778-4988-a6e9-e897ebe041d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:13.243730 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f687fede-2778-4988-a6e9-e897ebe041d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:13.244197 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f687fede-2778-4988-a6e9-e897ebe041d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:13.247212 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:13.306179 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f687fede-2778-4988-a6e9-e897ebe041d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:13.313466 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f687fede-2778-4988-a6e9-e897ebe041d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1138 microversion: 2.1 time: 0.083257 Aug 07 22:41:13.314032 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 209/395] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:13 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1138 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:13.788795 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-0ffefff6-e938-445c-af0e-31558b77de43 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:13.789410 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-0ffefff6-e938-445c-af0e-31558b77de43 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:13.795830 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0ffefff6-e938-445c-af0e-31558b77de43 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:13.796342 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0ffefff6-e938-445c-af0e-31558b77de43 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:13.796814 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0ffefff6-e938-445c-af0e-31558b77de43 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:13.797503 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0ffefff6-e938-445c-af0e-31558b77de43 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:13.797956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0ffefff6-e938-445c-af0e-31558b77de43 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:13.807283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0ffefff6-e938-445c-af0e-31558b77de43 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:13.937985 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-0ffefff6-e938-445c-af0e-31558b77de43 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:13.950286 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-0ffefff6-e938-445c-af0e-31558b77de43 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1266 microversion: 2.1 time: 0.162257 Aug 07 22:41:13.950286 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 187/396] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:13 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:14.335464 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-67010e13-cdd1-4d46-a796-0fde5c07ebf3 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:14.342105 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-67010e13-cdd1-4d46-a796-0fde5c07ebf3 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:14.342995 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-67010e13-cdd1-4d46-a796-0fde5c07ebf3 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:14.343479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-67010e13-cdd1-4d46-a796-0fde5c07ebf3 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:14.343912 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-67010e13-cdd1-4d46-a796-0fde5c07ebf3 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:14.344663 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-67010e13-cdd1-4d46-a796-0fde5c07ebf3 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:14.345113 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-67010e13-cdd1-4d46-a796-0fde5c07ebf3 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:14.345536 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-67010e13-cdd1-4d46-a796-0fde5c07ebf3 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:14.409200 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-67010e13-cdd1-4d46-a796-0fde5c07ebf3 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:14.416868 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-67010e13-cdd1-4d46-a796-0fde5c07ebf3 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1186 microversion: 2.1 time: 0.086166 Aug 07 22:41:14.417663 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 210/397] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:14 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1186 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:14.967506 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-85b54c0f-2074-4c65-9567-5e891b6fc954 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:14.972454 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-85b54c0f-2074-4c65-9567-5e891b6fc954 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:14.974731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-85b54c0f-2074-4c65-9567-5e891b6fc954 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:14.975261 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-85b54c0f-2074-4c65-9567-5e891b6fc954 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:14.975731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-85b54c0f-2074-4c65-9567-5e891b6fc954 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:14.976449 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-85b54c0f-2074-4c65-9567-5e891b6fc954 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:14.976943 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-85b54c0f-2074-4c65-9567-5e891b6fc954 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:14.977313 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-85b54c0f-2074-4c65-9567-5e891b6fc954 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:15.112212 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-85b54c0f-2074-4c65-9567-5e891b6fc954 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:15.126741 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-85b54c0f-2074-4c65-9567-5e891b6fc954 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1266 microversion: 2.1 time: 0.157029 Aug 07 22:41:15.126741 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 188/398] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:14 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:15.439880 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-65c18cbe-f36f-42ab-be8d-6d63098dcfc8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:15.441268 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-65c18cbe-f36f-42ab-be8d-6d63098dcfc8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:15.449086 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-65c18cbe-f36f-42ab-be8d-6d63098dcfc8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:15.449557 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-65c18cbe-f36f-42ab-be8d-6d63098dcfc8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:15.449998 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-65c18cbe-f36f-42ab-be8d-6d63098dcfc8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:15.450887 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-65c18cbe-f36f-42ab-be8d-6d63098dcfc8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:15.451612 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-65c18cbe-f36f-42ab-be8d-6d63098dcfc8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:15.452056 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-65c18cbe-f36f-42ab-be8d-6d63098dcfc8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:15.515690 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-65c18cbe-f36f-42ab-be8d-6d63098dcfc8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:15.524087 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-65c18cbe-f36f-42ab-be8d-6d63098dcfc8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1186 microversion: 2.1 time: 0.088644 Aug 07 22:41:15.524647 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 211/399] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:15 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1186 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:16.143585 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d6a7eeb7-b922-4c19-be6e-4d2b92e8b852 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:16.144126 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-d6a7eeb7-b922-4c19-be6e-4d2b92e8b852 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:16.148259 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:16.152282 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d6a7eeb7-b922-4c19-be6e-4d2b92e8b852 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:16.153151 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d6a7eeb7-b922-4c19-be6e-4d2b92e8b852 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:16.154019 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d6a7eeb7-b922-4c19-be6e-4d2b92e8b852 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:16.154731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d6a7eeb7-b922-4c19-be6e-4d2b92e8b852 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:16.155356 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d6a7eeb7-b922-4c19-be6e-4d2b92e8b852 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:16.155956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d6a7eeb7-b922-4c19-be6e-4d2b92e8b852 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:16.326059 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-5aef15db-eb33-4e19-9ad6-3db68c89fe50 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:16.326932 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-5aef15db-eb33-4e19-9ad6-3db68c89fe50 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:16.333411 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5aef15db-eb33-4e19-9ad6-3db68c89fe50 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:16.334139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5aef15db-eb33-4e19-9ad6-3db68c89fe50 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:16.334733 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5aef15db-eb33-4e19-9ad6-3db68c89fe50 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:16.335919 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5aef15db-eb33-4e19-9ad6-3db68c89fe50 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:16.336713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5aef15db-eb33-4e19-9ad6-3db68c89fe50 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:16.337337 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5aef15db-eb33-4e19-9ad6-3db68c89fe50 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:16.416751 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-d6a7eeb7-b922-4c19-be6e-4d2b92e8b852 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:16.426141 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-d6a7eeb7-b922-4c19-be6e-4d2b92e8b852 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1266 microversion: 2.1 time: 0.288502 Aug 07 22:41:16.427569 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 189/400] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:16 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1266 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:41:16.514330 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.objects.instance [None req-5aef15db-eb33-4e19-9ad6-3db68c89fe50 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lazy-loading 'services' on Instance uuid 24f48cf3-8b19-480b-b271-eef00858dbf2 {{(pid=129964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:41:16.544730 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-dbec84aa-3ad2-4ed2-a5d6-9c8c03a3d937 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:16.545338 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-dbec84aa-3ad2-4ed2-a5d6-9c8c03a3d937 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:16.556074 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-dbec84aa-3ad2-4ed2-a5d6-9c8c03a3d937 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:16.556565 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-dbec84aa-3ad2-4ed2-a5d6-9c8c03a3d937 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:16.556996 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-dbec84aa-3ad2-4ed2-a5d6-9c8c03a3d937 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:16.557767 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-dbec84aa-3ad2-4ed2-a5d6-9c8c03a3d937 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:16.558189 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-dbec84aa-3ad2-4ed2-a5d6-9c8c03a3d937 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:16.560296 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-dbec84aa-3ad2-4ed2-a5d6-9c8c03a3d937 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:16.683933 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-dbec84aa-3ad2-4ed2-a5d6-9c8c03a3d937 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:16.691629 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-dbec84aa-3ad2-4ed2-a5d6-9c8c03a3d937 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1204 microversion: 2.1 time: 0.150640 Aug 07 22:41:16.696150 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 190/401] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:16 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1204 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:16.697842 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-5c60e21a-ecfe-42cd-9762-c4c75fb4f64f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:41:16.700064 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-5c60e21a-ecfe-42cd-9762-c4c75fb4f64f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:16.705944 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5c60e21a-ecfe-42cd-9762-c4c75fb4f64f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:16.706425 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5c60e21a-ecfe-42cd-9762-c4c75fb4f64f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:16.706870 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5c60e21a-ecfe-42cd-9762-c4c75fb4f64f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:16.707564 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5c60e21a-ecfe-42cd-9762-c4c75fb4f64f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:16.708069 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5c60e21a-ecfe-42cd-9762-c4c75fb4f64f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:16.708490 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5c60e21a-ecfe-42cd-9762-c4c75fb4f64f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:16.735789 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.objects.instance [None req-5c60e21a-ecfe-42cd-9762-c4c75fb4f64f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lazy-loading 'flavor' on Instance uuid 62959a95-0c79-4d83-a375-147271e53ffa {{(pid=129965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:41:17.045320 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-5aef15db-eb33-4e19-9ad6-3db68c89fe50 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "DELETE /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2/os-volume_attachments/4d6dd438-44ee-4945-bbe4-16742d9af7c1" status: 202 len: 0 microversion: 2.1 time: 0.723280 Aug 07 22:41:17.061071 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 212/402] 10.222.0.30 () {58 vars in 1416 bytes} [Sun Aug 7 22:41:16 2022] DELETE /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2/os-volume_attachments/4d6dd438-44ee-4945-bbe4-16742d9af7c1 => generated 0 bytes in 725 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:41:17.344913 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-5c60e21a-ecfe-42cd-9762-c4c75fb4f64f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "POST /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa/action" status: 200 len: 32 microversion: 2.1 time: 0.651229 Aug 07 22:41:17.358611 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-dedef8d4-22c5-4a76-a02b-900283088adb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:17.359632 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-dedef8d4-22c5-4a76-a02b-900283088adb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:17.361834 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 191/403] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 22:41:16 2022] POST /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa/action => generated 32 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 22:41:17.367848 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dedef8d4-22c5-4a76-a02b-900283088adb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:17.368746 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dedef8d4-22c5-4a76-a02b-900283088adb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:17.372417 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dedef8d4-22c5-4a76-a02b-900283088adb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:17.372417 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dedef8d4-22c5-4a76-a02b-900283088adb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:17.372417 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dedef8d4-22c5-4a76-a02b-900283088adb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:17.372417 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dedef8d4-22c5-4a76-a02b-900283088adb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:17.450338 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d127548a-d33c-40ea-9ef4-a5a589965405 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:17.451541 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-d127548a-d33c-40ea-9ef4-a5a589965405 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:17.457916 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d127548a-d33c-40ea-9ef4-a5a589965405 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:17.465028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d127548a-d33c-40ea-9ef4-a5a589965405 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:17.465028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d127548a-d33c-40ea-9ef4-a5a589965405 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:17.465028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d127548a-d33c-40ea-9ef4-a5a589965405 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:17.465028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d127548a-d33c-40ea-9ef4-a5a589965405 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:17.465373 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d127548a-d33c-40ea-9ef4-a5a589965405 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:18.006870 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-dedef8d4-22c5-4a76-a02b-900283088adb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:18.015110 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-dedef8d4-22c5-4a76-a02b-900283088adb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1734 microversion: 2.1 time: 0.661636 Aug 07 22:41:18.015677 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 213/404] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:17 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1734 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:18.020299 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-bdfbaca7-18e2-4e81-95f4-bbceaf40fe0e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:18.020895 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-bdfbaca7-18e2-4e81-95f4-bbceaf40fe0e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:18.027009 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdfbaca7-18e2-4e81-95f4-bbceaf40fe0e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:18.027469 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdfbaca7-18e2-4e81-95f4-bbceaf40fe0e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:18.027923 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdfbaca7-18e2-4e81-95f4-bbceaf40fe0e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:18.028600 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdfbaca7-18e2-4e81-95f4-bbceaf40fe0e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:18.029218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdfbaca7-18e2-4e81-95f4-bbceaf40fe0e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:18.029633 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdfbaca7-18e2-4e81-95f4-bbceaf40fe0e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:18.103037 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-d127548a-d33c-40ea-9ef4-a5a589965405 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:18.110691 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-d127548a-d33c-40ea-9ef4-a5a589965405 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1266 microversion: 2.1 time: 0.664896 Aug 07 22:41:18.111288 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 192/405] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:17 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1266 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:41:18.328429 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-bdfbaca7-18e2-4e81-95f4-bbceaf40fe0e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:18.340067 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-bdfbaca7-18e2-4e81-95f4-bbceaf40fe0e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1260 microversion: 2.1 time: 0.323173 Aug 07 22:41:18.344800 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 214/406] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:18 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1260 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:18.793830 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-f91c0f22-1089-47d3-9ec1-0ec0d54b7a9f req-22e8837f-3edb-437a-9ae9-51d01b134e5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "750b85bc-6bb0-48e2-a912-7664384bcaa0", "name": "network-vif-plugged", "status": "completed", "tag": "c6e7b289-4e50-424d-9310-ffa0f3386876"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:41:18.804682 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-f91c0f22-1089-47d3-9ec1-0ec0d54b7a9f req-22e8837f-3edb-437a-9ae9-51d01b134e5f service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:18.805386 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-f91c0f22-1089-47d3-9ec1-0ec0d54b7a9f req-22e8837f-3edb-437a-9ae9-51d01b134e5f service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:18.805819 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-f91c0f22-1089-47d3-9ec1-0ec0d54b7a9f req-22e8837f-3edb-437a-9ae9-51d01b134e5f service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:18.818842 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-f91c0f22-1089-47d3-9ec1-0ec0d54b7a9f req-22e8837f-3edb-437a-9ae9-51d01b134e5f service nova] Creating event network-vif-plugged:c6e7b289-4e50-424d-9310-ffa0f3386876 for instance 750b85bc-6bb0-48e2-a912-7664384bcaa0 on hv-cinder-85032 Aug 07 22:41:18.823370 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-f91c0f22-1089-47d3-9ec1-0ec0d54b7a9f req-22e8837f-3edb-437a-9ae9-51d01b134e5f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034481 Aug 07 22:41:18.824355 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 193/407] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:41:18.871194 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-e06ef36c-b776-4f5c-bacf-6906b3e4b6a6 req-102ed65e-a6bb-4b36-979a-8758cbef9df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93991d13-4c43-4e03-9031-2d5032989994", "tag": "2b5b8b0f-84c3-482a-be06-dd81e2a229e1"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:41:18.881849 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-e06ef36c-b776-4f5c-bacf-6906b3e4b6a6 req-102ed65e-a6bb-4b36-979a-8758cbef9df4 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:18.882324 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-e06ef36c-b776-4f5c-bacf-6906b3e4b6a6 req-102ed65e-a6bb-4b36-979a-8758cbef9df4 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:18.882753 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-e06ef36c-b776-4f5c-bacf-6906b3e4b6a6 req-102ed65e-a6bb-4b36-979a-8758cbef9df4 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:18.894494 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-e06ef36c-b776-4f5c-bacf-6906b3e4b6a6 req-102ed65e-a6bb-4b36-979a-8758cbef9df4 service nova] Creating event network-changed:2b5b8b0f-84c3-482a-be06-dd81e2a229e1 for instance 93991d13-4c43-4e03-9031-2d5032989994 on hv-cinder-85032 Aug 07 22:41:18.899696 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-e06ef36c-b776-4f5c-bacf-6906b3e4b6a6 req-102ed65e-a6bb-4b36-979a-8758cbef9df4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032265 Aug 07 22:41:18.900539 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 215/408] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:41:19.036545 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-db47dda8-d146-432d-adbd-842d004b1734 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:19.037680 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-db47dda8-d146-432d-adbd-842d004b1734 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:19.044154 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-db47dda8-d146-432d-adbd-842d004b1734 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:19.044643 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-db47dda8-d146-432d-adbd-842d004b1734 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:19.045132 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-db47dda8-d146-432d-adbd-842d004b1734 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:19.045826 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-db47dda8-d146-432d-adbd-842d004b1734 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:19.046280 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-db47dda8-d146-432d-adbd-842d004b1734 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:19.046703 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-db47dda8-d146-432d-adbd-842d004b1734 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:19.133887 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-1b5f7e5e-5e53-4959-83b7-fc1dd9e14d68 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:19.134878 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-1b5f7e5e-5e53-4959-83b7-fc1dd9e14d68 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:19.141164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1b5f7e5e-5e53-4959-83b7-fc1dd9e14d68 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:19.141645 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1b5f7e5e-5e53-4959-83b7-fc1dd9e14d68 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:19.142076 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1b5f7e5e-5e53-4959-83b7-fc1dd9e14d68 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:19.142768 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1b5f7e5e-5e53-4959-83b7-fc1dd9e14d68 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:19.143215 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1b5f7e5e-5e53-4959-83b7-fc1dd9e14d68 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:19.143635 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1b5f7e5e-5e53-4959-83b7-fc1dd9e14d68 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:19.398805 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-db47dda8-d146-432d-adbd-842d004b1734 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:19.407518 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-db47dda8-d146-432d-adbd-842d004b1734 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1734 microversion: 2.1 time: 0.375463 Aug 07 22:41:19.416359 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 194/409] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:19 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1734 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:19.416359 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-1a33e317-1a85-4c86-afd5-e9618daa333f tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:19.416359 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-1a33e317-1a85-4c86-afd5-e9618daa333f tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:19.422248 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1a33e317-1a85-4c86-afd5-e9618daa333f tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:19.422806 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1a33e317-1a85-4c86-afd5-e9618daa333f tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:19.423312 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1a33e317-1a85-4c86-afd5-e9618daa333f tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:19.424111 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1a33e317-1a85-4c86-afd5-e9618daa333f tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:19.424637 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1a33e317-1a85-4c86-afd5-e9618daa333f tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:19.425153 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1a33e317-1a85-4c86-afd5-e9618daa333f tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:19.488295 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-1b5f7e5e-5e53-4959-83b7-fc1dd9e14d68 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:19.497431 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-1b5f7e5e-5e53-4959-83b7-fc1dd9e14d68 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1266 microversion: 2.1 time: 0.369137 Aug 07 22:41:19.498196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 216/410] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:19 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1266 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:41:19.502714 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-d1775198-1582-48d2-a10b-98d0030ba0fa tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:19.503302 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-d1775198-1582-48d2-a10b-98d0030ba0fa tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:19.510362 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d1775198-1582-48d2-a10b-98d0030ba0fa tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:19.510983 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d1775198-1582-48d2-a10b-98d0030ba0fa tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:19.511537 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d1775198-1582-48d2-a10b-98d0030ba0fa tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:19.512346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d1775198-1582-48d2-a10b-98d0030ba0fa tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:19.512850 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d1775198-1582-48d2-a10b-98d0030ba0fa tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:19.513324 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d1775198-1582-48d2-a10b-98d0030ba0fa tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:19.543578 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-d1775198-1582-48d2-a10b-98d0030ba0fa tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Going to try to terminate instance {{(pid=129964) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 22:41:19.611944 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-1a33e317-1a85-4c86-afd5-e9618daa333f tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:19.620420 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-1a33e317-1a85-4c86-afd5-e9618daa333f tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1260 microversion: 2.1 time: 0.211058 Aug 07 22:41:19.621069 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 195/411] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:19 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1260 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:19.808528 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-d1775198-1582-48d2-a10b-98d0030ba0fa tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "DELETE /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 204 len: 0 microversion: 2.1 time: 0.302995 Aug 07 22:41:19.808528 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 217/412] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:41:19 2022] DELETE /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 22:41:19.811997 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-1e9e572f-7ced-40b8-af75-adb3ef93d256 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:19.812616 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-1e9e572f-7ced-40b8-af75-adb3ef93d256 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:19.819526 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1e9e572f-7ced-40b8-af75-adb3ef93d256 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:19.819994 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1e9e572f-7ced-40b8-af75-adb3ef93d256 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:19.820448 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1e9e572f-7ced-40b8-af75-adb3ef93d256 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:19.821126 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1e9e572f-7ced-40b8-af75-adb3ef93d256 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:19.821574 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1e9e572f-7ced-40b8-af75-adb3ef93d256 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:19.821991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1e9e572f-7ced-40b8-af75-adb3ef93d256 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:19.952227 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-1e9e572f-7ced-40b8-af75-adb3ef93d256 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:19.960253 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-1e9e572f-7ced-40b8-af75-adb3ef93d256 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 200 len: 1511 microversion: 2.1 time: 0.152135 Aug 07 22:41:19.960823 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 196/413] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:19 2022] GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:20.431017 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-8fa79c99-f2ec-42d2-9bdf-757df927a6ce tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:20.431616 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-8fa79c99-f2ec-42d2-9bdf-757df927a6ce tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:20.438110 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8fa79c99-f2ec-42d2-9bdf-757df927a6ce tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:20.438585 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8fa79c99-f2ec-42d2-9bdf-757df927a6ce tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:20.439012 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8fa79c99-f2ec-42d2-9bdf-757df927a6ce tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:20.439682 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8fa79c99-f2ec-42d2-9bdf-757df927a6ce tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:20.440181 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8fa79c99-f2ec-42d2-9bdf-757df927a6ce tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:20.440599 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8fa79c99-f2ec-42d2-9bdf-757df927a6ce tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:20.518722 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-4b007a5e-93e6-4c60-a518-4f60dc34c24a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:20.519538 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-4b007a5e-93e6-4c60-a518-4f60dc34c24a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:20.525948 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4b007a5e-93e6-4c60-a518-4f60dc34c24a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:20.526427 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4b007a5e-93e6-4c60-a518-4f60dc34c24a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:20.526858 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4b007a5e-93e6-4c60-a518-4f60dc34c24a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:20.527540 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4b007a5e-93e6-4c60-a518-4f60dc34c24a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:20.527989 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4b007a5e-93e6-4c60-a518-4f60dc34c24a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:20.528440 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4b007a5e-93e6-4c60-a518-4f60dc34c24a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:20.583472 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-8fa79c99-f2ec-42d2-9bdf-757df927a6ce tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:20.591702 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-8fa79c99-f2ec-42d2-9bdf-757df927a6ce tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1734 microversion: 2.1 time: 0.165558 Aug 07 22:41:20.592288 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 218/414] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:20 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:20.642092 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-941e82b8-070a-4905-a453-37e3c7206df8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:20.642900 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-941e82b8-070a-4905-a453-37e3c7206df8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:20.649779 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-941e82b8-070a-4905-a453-37e3c7206df8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:20.650338 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-941e82b8-070a-4905-a453-37e3c7206df8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:20.650846 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-941e82b8-070a-4905-a453-37e3c7206df8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:20.651614 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-941e82b8-070a-4905-a453-37e3c7206df8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:20.652088 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-941e82b8-070a-4905-a453-37e3c7206df8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:20.652841 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-941e82b8-070a-4905-a453-37e3c7206df8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:20.671433 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-4b007a5e-93e6-4c60-a518-4f60dc34c24a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:20.680357 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-4b007a5e-93e6-4c60-a518-4f60dc34c24a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1266 microversion: 2.1 time: 0.165517 Aug 07 22:41:20.694585 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 197/415] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:20 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:41:20.788424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-941e82b8-070a-4905-a453-37e3c7206df8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:20.795869 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-941e82b8-070a-4905-a453-37e3c7206df8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1260 microversion: 2.1 time: 0.157919 Aug 07 22:41:20.796473 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 219/416] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:20 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:41:20.981928 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-b9da8614-fc8e-4d0f-9e98-b589fb31581f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:20.982531 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-b9da8614-fc8e-4d0f-9e98-b589fb31581f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:20.988570 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b9da8614-fc8e-4d0f-9e98-b589fb31581f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:20.988968 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b9da8614-fc8e-4d0f-9e98-b589fb31581f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:20.989396 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b9da8614-fc8e-4d0f-9e98-b589fb31581f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:20.990680 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b9da8614-fc8e-4d0f-9e98-b589fb31581f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:20.991129 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b9da8614-fc8e-4d0f-9e98-b589fb31581f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:20.991587 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b9da8614-fc8e-4d0f-9e98-b589fb31581f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:21.123911 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-b9da8614-fc8e-4d0f-9e98-b589fb31581f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:21.131440 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-b9da8614-fc8e-4d0f-9e98-b589fb31581f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 200 len: 1511 microversion: 2.1 time: 0.153577 Aug 07 22:41:21.132007 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 198/417] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:20 2022] GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:21.614199 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-cd0ffe8e-a7b2-4f18-8da1-ca0a3a1bed29 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:21.615475 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-cd0ffe8e-a7b2-4f18-8da1-ca0a3a1bed29 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:21.622839 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cd0ffe8e-a7b2-4f18-8da1-ca0a3a1bed29 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:21.623589 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cd0ffe8e-a7b2-4f18-8da1-ca0a3a1bed29 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:21.624346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cd0ffe8e-a7b2-4f18-8da1-ca0a3a1bed29 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:21.625324 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cd0ffe8e-a7b2-4f18-8da1-ca0a3a1bed29 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:21.625801 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cd0ffe8e-a7b2-4f18-8da1-ca0a3a1bed29 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:21.626272 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cd0ffe8e-a7b2-4f18-8da1-ca0a3a1bed29 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:21.701111 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-10f00fed-f37a-41cd-84a0-ecf93b032bf9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:21.701765 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-10f00fed-f37a-41cd-84a0-ecf93b032bf9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:21.705051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=2 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:21.705726 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=6 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:21.709526 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-10f00fed-f37a-41cd-84a0-ecf93b032bf9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:21.710200 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-10f00fed-f37a-41cd-84a0-ecf93b032bf9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:21.710640 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-10f00fed-f37a-41cd-84a0-ecf93b032bf9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:21.711324 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-10f00fed-f37a-41cd-84a0-ecf93b032bf9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:21.711772 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-10f00fed-f37a-41cd-84a0-ecf93b032bf9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:21.712220 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-10f00fed-f37a-41cd-84a0-ecf93b032bf9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:21.795935 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-cd0ffe8e-a7b2-4f18-8da1-ca0a3a1bed29 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:21.805831 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-cd0ffe8e-a7b2-4f18-8da1-ca0a3a1bed29 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1734 microversion: 2.1 time: 0.196115 Aug 07 22:41:21.806732 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 220/418] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:21 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1734 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:21.818298 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-11a0d87b-4243-4468-bb03-7888eed2f0c0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:21.819177 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-11a0d87b-4243-4468-bb03-7888eed2f0c0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:21.826671 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-11a0d87b-4243-4468-bb03-7888eed2f0c0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:21.827446 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-11a0d87b-4243-4468-bb03-7888eed2f0c0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:21.827885 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-11a0d87b-4243-4468-bb03-7888eed2f0c0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:21.829022 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-11a0d87b-4243-4468-bb03-7888eed2f0c0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:21.829484 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-11a0d87b-4243-4468-bb03-7888eed2f0c0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:21.830280 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-11a0d87b-4243-4468-bb03-7888eed2f0c0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:21.964373 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-10f00fed-f37a-41cd-84a0-ecf93b032bf9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:21.966772 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:21.981441 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-10f00fed-f37a-41cd-84a0-ecf93b032bf9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1266 microversion: 2.1 time: 0.283903 Aug 07 22:41:21.982436 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 199/419] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:21 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:41:22.057033 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-11a0d87b-4243-4468-bb03-7888eed2f0c0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:22.064589 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-11a0d87b-4243-4468-bb03-7888eed2f0c0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1260 microversion: 2.1 time: 0.250855 Aug 07 22:41:22.065171 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 221/420] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:21 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1260 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:22.153516 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-69d1db4c-a148-48a3-be5c-2f116a537066 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:22.154226 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-69d1db4c-a148-48a3-be5c-2f116a537066 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:22.161395 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-69d1db4c-a148-48a3-be5c-2f116a537066 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:22.162439 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-69d1db4c-a148-48a3-be5c-2f116a537066 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:22.163351 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-69d1db4c-a148-48a3-be5c-2f116a537066 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:22.164225 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-69d1db4c-a148-48a3-be5c-2f116a537066 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:22.164961 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-69d1db4c-a148-48a3-be5c-2f116a537066 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:22.165533 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-69d1db4c-a148-48a3-be5c-2f116a537066 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:22.314501 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-69d1db4c-a148-48a3-be5c-2f116a537066 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:22.322141 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-69d1db4c-a148-48a3-be5c-2f116a537066 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 200 len: 1511 microversion: 2.1 time: 0.172721 Aug 07 22:41:22.322700 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 200/421] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:22 2022] GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:22.828482 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-e9980307-09dc-4419-b024-58b16b04320e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:22.829083 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-e9980307-09dc-4419-b024-58b16b04320e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:22.831085 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=2 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:22.836767 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e9980307-09dc-4419-b024-58b16b04320e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:22.837243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e9980307-09dc-4419-b024-58b16b04320e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:22.837680 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e9980307-09dc-4419-b024-58b16b04320e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:22.838362 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e9980307-09dc-4419-b024-58b16b04320e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:22.838817 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e9980307-09dc-4419-b024-58b16b04320e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:22.839232 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e9980307-09dc-4419-b024-58b16b04320e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:23.004711 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-13da2329-a550-438c-b9f8-421a3f924f2d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:23.010237 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-13da2329-a550-438c-b9f8-421a3f924f2d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:23.012263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-13da2329-a550-438c-b9f8-421a3f924f2d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:23.012739 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-13da2329-a550-438c-b9f8-421a3f924f2d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:23.013291 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-13da2329-a550-438c-b9f8-421a3f924f2d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:23.014014 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-13da2329-a550-438c-b9f8-421a3f924f2d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:23.014421 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-13da2329-a550-438c-b9f8-421a3f924f2d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:23.014836 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-13da2329-a550-438c-b9f8-421a3f924f2d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:23.027540 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-e9980307-09dc-4419-b024-58b16b04320e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:23.039015 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-e9980307-09dc-4419-b024-58b16b04320e tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1734 microversion: 2.1 time: 0.214226 Aug 07 22:41:23.041356 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 222/422] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:22 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1734 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:23.059895 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-f8615790-6c59-4daf-a47b-3c51519dd89a req-a2b423ed-aee8-49a3-8ac9-ebdadc6b75d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f48cf3-8b19-480b-b271-eef00858dbf2", "name": "network-vif-deleted", "tag": "4b161e96-ab40-40a7-94b4-baefa79fd50f"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:41:23.070532 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-f8615790-6c59-4daf-a47b-3c51519dd89a req-a2b423ed-aee8-49a3-8ac9-ebdadc6b75d0 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:23.071004 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-f8615790-6c59-4daf-a47b-3c51519dd89a req-a2b423ed-aee8-49a3-8ac9-ebdadc6b75d0 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:23.071432 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-f8615790-6c59-4daf-a47b-3c51519dd89a req-a2b423ed-aee8-49a3-8ac9-ebdadc6b75d0 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:23.086334 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-f8615790-6c59-4daf-a47b-3c51519dd89a req-a2b423ed-aee8-49a3-8ac9-ebdadc6b75d0 service nova] Creating event network-vif-deleted:4b161e96-ab40-40a7-94b4-baefa79fd50f for instance 24f48cf3-8b19-480b-b271-eef00858dbf2 on hv-cinder-85032 Aug 07 22:41:23.091673 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-f8615790-6c59-4daf-a47b-3c51519dd89a req-a2b423ed-aee8-49a3-8ac9-ebdadc6b75d0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035721 Aug 07 22:41:23.092322 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 223/423] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:41:23.097671 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b52436b7-8281-4cdc-8817-c8f5a130e7ff tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:23.098372 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-b52436b7-8281-4cdc-8817-c8f5a130e7ff tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:23.106027 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b52436b7-8281-4cdc-8817-c8f5a130e7ff tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:23.106519 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b52436b7-8281-4cdc-8817-c8f5a130e7ff tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:23.110574 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b52436b7-8281-4cdc-8817-c8f5a130e7ff tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:23.110574 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b52436b7-8281-4cdc-8817-c8f5a130e7ff tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:23.110574 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b52436b7-8281-4cdc-8817-c8f5a130e7ff tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:23.110574 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b52436b7-8281-4cdc-8817-c8f5a130e7ff tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:23.161189 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-13da2329-a550-438c-b9f8-421a3f924f2d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:23.178611 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-13da2329-a550-438c-b9f8-421a3f924f2d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1454 microversion: 2.1 time: 0.176632 Aug 07 22:41:23.182694 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 201/424] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:22 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1454 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:41:23.200291 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d56875fa-c4b0-4c7a-a6aa-39c0ada53f57 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:23.200910 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-d56875fa-c4b0-4c7a-a6aa-39c0ada53f57 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:23.206996 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d56875fa-c4b0-4c7a-a6aa-39c0ada53f57 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:23.208124 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d56875fa-c4b0-4c7a-a6aa-39c0ada53f57 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:23.208124 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d56875fa-c4b0-4c7a-a6aa-39c0ada53f57 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:23.208758 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d56875fa-c4b0-4c7a-a6aa-39c0ada53f57 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:23.209303 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d56875fa-c4b0-4c7a-a6aa-39c0ada53f57 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:23.209632 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d56875fa-c4b0-4c7a-a6aa-39c0ada53f57 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:23.541741 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-b52436b7-8281-4cdc-8817-c8f5a130e7ff tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:23.544103 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:23.549958 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-b52436b7-8281-4cdc-8817-c8f5a130e7ff tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1260 microversion: 2.1 time: 0.456554 Aug 07 22:41:23.550521 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 224/425] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:23 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1260 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:23.555003 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-2b459b66-3584-46f5-843c-3a43fddee247 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:23.555592 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-2b459b66-3584-46f5-843c-3a43fddee247 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:23.561314 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2b459b66-3584-46f5-843c-3a43fddee247 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:23.561791 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2b459b66-3584-46f5-843c-3a43fddee247 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:23.562215 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2b459b66-3584-46f5-843c-3a43fddee247 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:23.562903 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2b459b66-3584-46f5-843c-3a43fddee247 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:23.563356 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2b459b66-3584-46f5-843c-3a43fddee247 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:23.563755 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2b459b66-3584-46f5-843c-3a43fddee247 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:23.587714 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-d56875fa-c4b0-4c7a-a6aa-39c0ada53f57 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:23.595632 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-d56875fa-c4b0-4c7a-a6aa-39c0ada53f57 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1454 microversion: 2.1 time: 0.399963 Aug 07 22:41:23.596173 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2b459b66-3584-46f5-843c-3a43fddee247 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:23.596551 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 202/426] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:23 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1454 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:41:23.596688 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2b459b66-3584-46f5-843c-3a43fddee247 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:23.597065 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2b459b66-3584-46f5-843c-3a43fddee247 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:23.597504 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.objects.instance [None req-2b459b66-3584-46f5-843c-3a43fddee247 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lazy-loading 'fault' on Instance uuid 24f48cf3-8b19-480b-b271-eef00858dbf2 {{(pid=129964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:41:23.642283 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-2b459b66-3584-46f5-843c-3a43fddee247 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:23.651326 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-2b459b66-3584-46f5-843c-3a43fddee247 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 200 len: 1307 microversion: 2.1 time: 0.099845 Aug 07 22:41:23.651885 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 225/427] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:23 2022] GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 1307 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:24.062613 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-3d0495c8-8698-47d5-b6f9-4015edddd297 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:24.063229 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-3d0495c8-8698-47d5-b6f9-4015edddd297 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:24.070146 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3d0495c8-8698-47d5-b6f9-4015edddd297 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:24.070718 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3d0495c8-8698-47d5-b6f9-4015edddd297 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:24.071135 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3d0495c8-8698-47d5-b6f9-4015edddd297 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:24.071913 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3d0495c8-8698-47d5-b6f9-4015edddd297 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:24.072390 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3d0495c8-8698-47d5-b6f9-4015edddd297 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:24.072811 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3d0495c8-8698-47d5-b6f9-4015edddd297 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:24.205173 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-3d0495c8-8698-47d5-b6f9-4015edddd297 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:24.214167 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-3d0495c8-8698-47d5-b6f9-4015edddd297 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1734 microversion: 2.1 time: 0.155941 Aug 07 22:41:24.214847 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 203/428] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:24 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:24.573448 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-97a1717a-8693-47fe-9564-158cf4a61aed tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:24.574079 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-97a1717a-8693-47fe-9564-158cf4a61aed tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:24.580734 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-97a1717a-8693-47fe-9564-158cf4a61aed tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:24.581772 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-97a1717a-8693-47fe-9564-158cf4a61aed tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:24.581772 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-97a1717a-8693-47fe-9564-158cf4a61aed tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:24.582466 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-97a1717a-8693-47fe-9564-158cf4a61aed tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:24.582916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-97a1717a-8693-47fe-9564-158cf4a61aed tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:24.583458 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-97a1717a-8693-47fe-9564-158cf4a61aed tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:24.672149 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-bed35d29-b4b8-4941-9c61-348a527cc456 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:24.672759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-bed35d29-b4b8-4941-9c61-348a527cc456 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: 24f48cf3-8b19-480b-b271-eef00858dbf2] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:24.679336 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bed35d29-b4b8-4941-9c61-348a527cc456 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:24.679883 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bed35d29-b4b8-4941-9c61-348a527cc456 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:24.680361 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bed35d29-b4b8-4941-9c61-348a527cc456 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:24.681025 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bed35d29-b4b8-4941-9c61-348a527cc456 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:24.681479 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bed35d29-b4b8-4941-9c61-348a527cc456 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:24.681892 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bed35d29-b4b8-4941-9c61-348a527cc456 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:24.697437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.wsgi [None req-bed35d29-b4b8-4941-9c61-348a527cc456 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] HTTP exception thrown: Instance 24f48cf3-8b19-480b-b271-eef00858dbf2 could not be found. Aug 07 22:41:24.699485 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-bed35d29-b4b8-4941-9c61-348a527cc456 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Request method failure captured: Aug 07 22:41:24.699485 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: request: GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 HTTP/1.1 Aug 07 22:41:24.699485 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept: application/json Aug 07 22:41:24.699485 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept-Encoding: identity Aug 07 22:41:24.699485 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Connection: close Aug 07 22:41:24.699485 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Length: 0 Aug 07 22:41:24.699485 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Type: application/json Aug 07 22:41:24.699485 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Host: 10.222.0.30 Aug 07 22:41:24.699485 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Openstack-System-Scope: None Aug 07 22:41:24.699485 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: User-Agent: python-urllib3/1.26.11 Aug 07 22:41:24.699485 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Auth-Token: gAAAAABi8D8qwhX0wEgCjggI2A9gjlcsoKEaGkxFTU7JyBlNHNlAv-aSV7wspm9dyBC4W8hnBLcA9P27Rn10NvLU4VkitNy0IPGTxN4-9-qdSrlvf9YMuqjQNjVY2b9Y43nalaNvMgcU9XnOZvSGAo4KwUj7FimQ9xEmPzEXPTra09d2ESpTFi0 Aug 07 22:41:24.699485 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Id: None Aug 07 22:41:24.699485 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Name: None Aug 07 22:41:24.699485 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Identity-Status: Confirmed Aug 07 22:41:24.699485 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Is-Admin-Project: True Aug 07 22:41:24.699485 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Id: default Aug 07 22:41:24.699485 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Name: Default Aug 07 22:41:24.699485 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Id: 5eea609cee794549a2c23cdb24fbb572 Aug 07 22:41:24.699485 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Name: tempest-VolumesSnapshotTestJSON-211203851 Aug 07 22:41:24.699485 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Role: reader,member Aug 07 22:41:24.699485 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Roles: reader,member Aug 07 22:41:24.701102 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5eea609cee794549a2c23cdb24fbb572"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5eea609cee794549a2c23cdb24fbb572"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5eea609cee794549a2c23cdb24fbb572"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5eea609cee794549a2c23cdb24fbb572"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:41:24.701102 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant: tempest-VolumesSnapshotTestJSON-211203851 Aug 07 22:41:24.701102 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Id: 5eea609cee794549a2c23cdb24fbb572 Aug 07 22:41:24.701102 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-211203851 Aug 07 22:41:24.701102 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User: tempest-VolumesSnapshotTestJSON-211203851-project Aug 07 22:41:24.701102 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Id: default Aug 07 22:41:24.701102 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Name: Default Aug 07 22:41:24.701102 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Id: def1da13ff2a47ada8e5f453061e3f7c Aug 07 22:41:24.701102 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Name: tempest-VolumesSnapshotTestJSON-211203851-project Aug 07 22:41:24.701102 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: method: > Aug 07 22:41:24.701102 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: exception: Instance 24f48cf3-8b19-480b-b271-eef00858dbf2 could not be found. Aug 07 22:41:24.701102 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: action_args: {'id': '24f48cf3-8b19-480b-b271-eef00858dbf2'} Aug 07 22:41:24.701939 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:41:24.701939 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:41:24.701939 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:41:24.701939 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:41:24.701939 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:41:24.701939 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:41:24.701939 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:41:24.701939 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:41:24.701939 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:41:24.701939 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:41:24.701939 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24f48cf3-8b19-480b-b271-eef00858dbf2 could not be found. Aug 07 22:41:24.701939 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:41:24.701939 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:41:24.701939 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:41:24.701939 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:41:24.701939 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:41:24.701939 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:41:24.701939 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:41:24.701939 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:41:24.701939 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:41:24.703509 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:41:24.703509 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:41:24.703509 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:41:24.703509 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:41:24.703509 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:41:24.703509 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:41:24.703509 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:41:24.703509 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24f48cf3-8b19-480b-b271-eef00858dbf2 could not be found. Aug 07 22:41:24.703509 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:41:24.703509 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:41:24.703509 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:41:24.703509 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:41:24.703509 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:41:24.703509 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:41:24.703509 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:41:24.703509 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:41:24.703509 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24f48cf3-8b19-480b-b271-eef00858dbf2 could not be found. Aug 07 22:41:24.703509 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:41:24.705697 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-bed35d29-b4b8-4941-9c61-348a527cc456 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Returning 404 to user: Instance 24f48cf3-8b19-480b-b271-eef00858dbf2 could not be found. {{(pid=129965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:41:24.706719 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-bed35d29-b4b8-4941-9c61-348a527cc456 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2" status: 404 len: 111 microversion: 2.1 time: 0.038514 Aug 07 22:41:24.707572 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 204/429] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:24 2022] GET /compute/v2.1/servers/24f48cf3-8b19-480b-b271-eef00858dbf2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 22:41:24.724101 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-97a1717a-8693-47fe-9564-158cf4a61aed tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:24.730335 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-97a1717a-8693-47fe-9564-158cf4a61aed tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1260 microversion: 2.1 time: 0.162056 Aug 07 22:41:24.745456 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 226/430] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:24 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:25.236711 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d53b4c5c-9006-4a76-b833-a98ad926fe1c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:25.238049 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-d53b4c5c-9006-4a76-b833-a98ad926fe1c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:25.245321 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d53b4c5c-9006-4a76-b833-a98ad926fe1c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:25.245794 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d53b4c5c-9006-4a76-b833-a98ad926fe1c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:25.246266 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d53b4c5c-9006-4a76-b833-a98ad926fe1c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:25.246953 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d53b4c5c-9006-4a76-b833-a98ad926fe1c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:25.247399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d53b4c5c-9006-4a76-b833-a98ad926fe1c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:25.247813 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d53b4c5c-9006-4a76-b833-a98ad926fe1c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:25.382901 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-d53b4c5c-9006-4a76-b833-a98ad926fe1c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:25.391046 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-d53b4c5c-9006-4a76-b833-a98ad926fe1c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1734 microversion: 2.1 time: 0.158384 Aug 07 22:41:25.391607 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 205/431] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:25 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:25.749291 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-ce5ec44d-1567-43c9-a857-89bc08dc825f req-14a00efc-81de-4a33-878e-5db590778149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "750b85bc-6bb0-48e2-a912-7664384bcaa0", "tag": "c6e7b289-4e50-424d-9310-ffa0f3386876"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:41:25.759286 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-ce5ec44d-1567-43c9-a857-89bc08dc825f req-14a00efc-81de-4a33-878e-5db590778149 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:25.760483 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-ce5ec44d-1567-43c9-a857-89bc08dc825f req-14a00efc-81de-4a33-878e-5db590778149 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:25.760913 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-ce5ec44d-1567-43c9-a857-89bc08dc825f req-14a00efc-81de-4a33-878e-5db590778149 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:25.764790 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-f8ade0f2-f92e-45f1-8a5e-a43281275838 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:25.765723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-f8ade0f2-f92e-45f1-8a5e-a43281275838 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:25.774203 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f8ade0f2-f92e-45f1-8a5e-a43281275838 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:25.774384 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-ce5ec44d-1567-43c9-a857-89bc08dc825f req-14a00efc-81de-4a33-878e-5db590778149 service nova] Creating event network-changed:c6e7b289-4e50-424d-9310-ffa0f3386876 for instance 750b85bc-6bb0-48e2-a912-7664384bcaa0 on hv-cinder-85032 Aug 07 22:41:25.775009 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f8ade0f2-f92e-45f1-8a5e-a43281275838 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:25.775637 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f8ade0f2-f92e-45f1-8a5e-a43281275838 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:25.776648 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f8ade0f2-f92e-45f1-8a5e-a43281275838 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:25.777273 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f8ade0f2-f92e-45f1-8a5e-a43281275838 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:25.777700 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f8ade0f2-f92e-45f1-8a5e-a43281275838 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:25.779243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-ce5ec44d-1567-43c9-a857-89bc08dc825f req-14a00efc-81de-4a33-878e-5db590778149 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033539 Aug 07 22:41:25.780227 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 227/432] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:41:25.909529 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f8ade0f2-f92e-45f1-8a5e-a43281275838 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:25.917765 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-f8ade0f2-f92e-45f1-8a5e-a43281275838 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1260 microversion: 2.1 time: 0.156833 Aug 07 22:41:25.918326 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 206/433] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:25 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:26.413438 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-3fd3ea1f-fed1-4d03-a880-cf070c989acb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:26.414137 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-3fd3ea1f-fed1-4d03-a880-cf070c989acb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:26.420895 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3fd3ea1f-fed1-4d03-a880-cf070c989acb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:26.421417 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3fd3ea1f-fed1-4d03-a880-cf070c989acb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:26.421854 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3fd3ea1f-fed1-4d03-a880-cf070c989acb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:26.422557 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3fd3ea1f-fed1-4d03-a880-cf070c989acb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:26.423011 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3fd3ea1f-fed1-4d03-a880-cf070c989acb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:26.423436 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3fd3ea1f-fed1-4d03-a880-cf070c989acb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:26.564556 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-3fd3ea1f-fed1-4d03-a880-cf070c989acb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:26.574001 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-3fd3ea1f-fed1-4d03-a880-cf070c989acb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1734 microversion: 2.1 time: 0.165569 Aug 07 22:41:26.585816 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 228/434] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:26 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:26.938374 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-1ec308e2-1390-4499-a7b3-4c50ae8b8470 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:26.938973 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-1ec308e2-1390-4499-a7b3-4c50ae8b8470 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:26.945670 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1ec308e2-1390-4499-a7b3-4c50ae8b8470 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:26.946141 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1ec308e2-1390-4499-a7b3-4c50ae8b8470 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:26.946566 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1ec308e2-1390-4499-a7b3-4c50ae8b8470 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:26.947245 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1ec308e2-1390-4499-a7b3-4c50ae8b8470 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:26.947690 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1ec308e2-1390-4499-a7b3-4c50ae8b8470 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:26.948143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1ec308e2-1390-4499-a7b3-4c50ae8b8470 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:27.080115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-1ec308e2-1390-4499-a7b3-4c50ae8b8470 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:27.088068 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-1ec308e2-1390-4499-a7b3-4c50ae8b8470 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1260 microversion: 2.1 time: 0.153573 Aug 07 22:41:27.088625 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 207/435] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:26 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:27.596209 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-561142ad-a769-4619-82bd-492ccae489bc tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:27.596843 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-561142ad-a769-4619-82bd-492ccae489bc tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:27.603600 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-561142ad-a769-4619-82bd-492ccae489bc tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:27.604108 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-561142ad-a769-4619-82bd-492ccae489bc tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:27.604592 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-561142ad-a769-4619-82bd-492ccae489bc tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:27.605286 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-561142ad-a769-4619-82bd-492ccae489bc tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:27.605734 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-561142ad-a769-4619-82bd-492ccae489bc tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:27.606151 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-561142ad-a769-4619-82bd-492ccae489bc tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:27.734028 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-561142ad-a769-4619-82bd-492ccae489bc tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:27.742631 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-561142ad-a769-4619-82bd-492ccae489bc tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1734 microversion: 2.1 time: 0.150284 Aug 07 22:41:27.743195 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 229/436] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:27 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:41:28.108128 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ab779aba-cc28-4408-96bf-2686c93c3708 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:28.108788 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-ab779aba-cc28-4408-96bf-2686c93c3708 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:28.115266 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ab779aba-cc28-4408-96bf-2686c93c3708 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:28.115744 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ab779aba-cc28-4408-96bf-2686c93c3708 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:28.119033 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ab779aba-cc28-4408-96bf-2686c93c3708 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:28.119033 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ab779aba-cc28-4408-96bf-2686c93c3708 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:28.119033 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ab779aba-cc28-4408-96bf-2686c93c3708 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:28.119033 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ab779aba-cc28-4408-96bf-2686c93c3708 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:28.253740 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-ab779aba-cc28-4408-96bf-2686c93c3708 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:28.262313 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-ab779aba-cc28-4408-96bf-2686c93c3708 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1260 microversion: 2.1 time: 0.158098 Aug 07 22:41:28.262870 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 208/437] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:28 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:28.764896 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-1c851e5f-89a7-45d7-96ca-07f37c0577f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:28.765496 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-1c851e5f-89a7-45d7-96ca-07f37c0577f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:28.771995 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1c851e5f-89a7-45d7-96ca-07f37c0577f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:28.772491 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1c851e5f-89a7-45d7-96ca-07f37c0577f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:28.772922 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1c851e5f-89a7-45d7-96ca-07f37c0577f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:28.773596 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1c851e5f-89a7-45d7-96ca-07f37c0577f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:28.774033 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1c851e5f-89a7-45d7-96ca-07f37c0577f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:28.774450 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1c851e5f-89a7-45d7-96ca-07f37c0577f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:28.903736 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-1c851e5f-89a7-45d7-96ca-07f37c0577f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:28.911705 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-1c851e5f-89a7-45d7-96ca-07f37c0577f7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1734 microversion: 2.1 time: 0.150844 Aug 07 22:41:28.912325 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 230/438] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:28 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:29.283420 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7f529e6d-5ca9-47fa-9cfb-8d90d46b33a0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:29.284573 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-7f529e6d-5ca9-47fa-9cfb-8d90d46b33a0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:29.291638 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7f529e6d-5ca9-47fa-9cfb-8d90d46b33a0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:29.292239 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7f529e6d-5ca9-47fa-9cfb-8d90d46b33a0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:29.292760 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7f529e6d-5ca9-47fa-9cfb-8d90d46b33a0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:29.293527 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7f529e6d-5ca9-47fa-9cfb-8d90d46b33a0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:29.294132 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7f529e6d-5ca9-47fa-9cfb-8d90d46b33a0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:29.294654 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7f529e6d-5ca9-47fa-9cfb-8d90d46b33a0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:29.577664 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7f529e6d-5ca9-47fa-9cfb-8d90d46b33a0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:29.586365 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-7f529e6d-5ca9-47fa-9cfb-8d90d46b33a0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1260 microversion: 2.1 time: 0.307270 Aug 07 22:41:29.586945 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 209/439] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:29 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1260 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:29.932801 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-430466e1-d9c1-47b9-9f8b-47ae2ded941f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:29.933494 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-430466e1-d9c1-47b9-9f8b-47ae2ded941f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:29.940489 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-430466e1-d9c1-47b9-9f8b-47ae2ded941f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:29.940647 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-430466e1-d9c1-47b9-9f8b-47ae2ded941f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:29.941073 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-430466e1-d9c1-47b9-9f8b-47ae2ded941f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:29.942262 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-430466e1-d9c1-47b9-9f8b-47ae2ded941f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:29.943194 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-430466e1-d9c1-47b9-9f8b-47ae2ded941f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:29.943625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-430466e1-d9c1-47b9-9f8b-47ae2ded941f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:30.227461 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-430466e1-d9c1-47b9-9f8b-47ae2ded941f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:30.235797 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-430466e1-d9c1-47b9-9f8b-47ae2ded941f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1734 microversion: 2.1 time: 0.306953 Aug 07 22:41:30.236405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 231/440] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:29 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1734 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:30.610420 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ca9d796e-a1e5-4d9f-963c-e0244204e440 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:30.611023 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-ca9d796e-a1e5-4d9f-963c-e0244204e440 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:30.619897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ca9d796e-a1e5-4d9f-963c-e0244204e440 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:30.619897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ca9d796e-a1e5-4d9f-963c-e0244204e440 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:30.619897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ca9d796e-a1e5-4d9f-963c-e0244204e440 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:30.630700 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ca9d796e-a1e5-4d9f-963c-e0244204e440 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:30.631292 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ca9d796e-a1e5-4d9f-963c-e0244204e440 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:30.632447 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ca9d796e-a1e5-4d9f-963c-e0244204e440 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:30.783052 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-ca9d796e-a1e5-4d9f-963c-e0244204e440 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:30.791458 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-ca9d796e-a1e5-4d9f-963c-e0244204e440 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1260 microversion: 2.1 time: 0.184794 Aug 07 22:41:30.792044 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 210/441] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:30 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:31.257318 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-107904cb-4315-4bbe-bce9-f8747277a62b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:31.257926 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-107904cb-4315-4bbe-bce9-f8747277a62b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:31.264600 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-107904cb-4315-4bbe-bce9-f8747277a62b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:31.265092 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-107904cb-4315-4bbe-bce9-f8747277a62b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:31.265530 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-107904cb-4315-4bbe-bce9-f8747277a62b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:31.266222 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-107904cb-4315-4bbe-bce9-f8747277a62b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:31.266673 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-107904cb-4315-4bbe-bce9-f8747277a62b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:31.267093 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-107904cb-4315-4bbe-bce9-f8747277a62b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:31.398531 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-107904cb-4315-4bbe-bce9-f8747277a62b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:31.406476 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-107904cb-4315-4bbe-bce9-f8747277a62b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1734 microversion: 2.1 time: 0.153050 Aug 07 22:41:31.407029 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 232/442] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:31 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:31.812867 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-0c2eef36-a337-4537-b59d-9e863af641cb tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:31.814633 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-0c2eef36-a337-4537-b59d-9e863af641cb tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:31.821664 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0c2eef36-a337-4537-b59d-9e863af641cb tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:31.822144 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0c2eef36-a337-4537-b59d-9e863af641cb tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:31.822581 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0c2eef36-a337-4537-b59d-9e863af641cb tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:31.823267 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0c2eef36-a337-4537-b59d-9e863af641cb tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:31.823727 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0c2eef36-a337-4537-b59d-9e863af641cb tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:31.824187 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0c2eef36-a337-4537-b59d-9e863af641cb tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:31.952849 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-0c2eef36-a337-4537-b59d-9e863af641cb tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:31.960864 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-0c2eef36-a337-4537-b59d-9e863af641cb tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1260 microversion: 2.1 time: 0.151806 Aug 07 22:41:31.961423 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 211/443] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:31 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:32.428133 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-ce039096-fd6e-45c5-bdde-6c8d4ae82d36 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:32.428774 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-ce039096-fd6e-45c5-bdde-6c8d4ae82d36 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:32.435143 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ce039096-fd6e-45c5-bdde-6c8d4ae82d36 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:32.435618 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ce039096-fd6e-45c5-bdde-6c8d4ae82d36 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:32.436072 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ce039096-fd6e-45c5-bdde-6c8d4ae82d36 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:32.436759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ce039096-fd6e-45c5-bdde-6c8d4ae82d36 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:32.437209 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ce039096-fd6e-45c5-bdde-6c8d4ae82d36 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:32.437631 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ce039096-fd6e-45c5-bdde-6c8d4ae82d36 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:32.566084 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-ce039096-fd6e-45c5-bdde-6c8d4ae82d36 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:32.574739 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-ce039096-fd6e-45c5-bdde-6c8d4ae82d36 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1734 microversion: 2.1 time: 0.151085 Aug 07 22:41:32.575303 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 233/444] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:32 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:32.988070 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-823ef2fd-8766-425c-a85b-986411bedf65 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:32.988070 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-823ef2fd-8766-425c-a85b-986411bedf65 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:32.988070 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-823ef2fd-8766-425c-a85b-986411bedf65 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:32.988689 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-823ef2fd-8766-425c-a85b-986411bedf65 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:32.988826 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-823ef2fd-8766-425c-a85b-986411bedf65 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:32.990159 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-823ef2fd-8766-425c-a85b-986411bedf65 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:32.990646 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-823ef2fd-8766-425c-a85b-986411bedf65 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:32.991065 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-823ef2fd-8766-425c-a85b-986411bedf65 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:33.121283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-823ef2fd-8766-425c-a85b-986411bedf65 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:33.128731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-823ef2fd-8766-425c-a85b-986411bedf65 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1260 microversion: 2.1 time: 0.151830 Aug 07 22:41:33.129290 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 212/445] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:32 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:33.597239 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-eb23f09f-8c92-4ffa-8226-4d6a5fd3d844 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:33.597838 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-eb23f09f-8c92-4ffa-8226-4d6a5fd3d844 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:33.604436 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-eb23f09f-8c92-4ffa-8226-4d6a5fd3d844 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:33.604909 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-eb23f09f-8c92-4ffa-8226-4d6a5fd3d844 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:33.605337 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-eb23f09f-8c92-4ffa-8226-4d6a5fd3d844 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:33.606010 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-eb23f09f-8c92-4ffa-8226-4d6a5fd3d844 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:33.606474 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-eb23f09f-8c92-4ffa-8226-4d6a5fd3d844 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:33.606869 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-eb23f09f-8c92-4ffa-8226-4d6a5fd3d844 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:33.735400 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-eb23f09f-8c92-4ffa-8226-4d6a5fd3d844 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:33.743998 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-eb23f09f-8c92-4ffa-8226-4d6a5fd3d844 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1734 microversion: 2.1 time: 0.150619 Aug 07 22:41:33.744574 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 234/446] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:33 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:34.149094 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-99fbfd99-c71f-44b2-9d35-c2605e8dec3b tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:34.149691 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-99fbfd99-c71f-44b2-9d35-c2605e8dec3b tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:34.156221 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-99fbfd99-c71f-44b2-9d35-c2605e8dec3b tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:34.156692 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-99fbfd99-c71f-44b2-9d35-c2605e8dec3b tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:34.157119 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-99fbfd99-c71f-44b2-9d35-c2605e8dec3b tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:34.157793 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-99fbfd99-c71f-44b2-9d35-c2605e8dec3b tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:34.158238 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-99fbfd99-c71f-44b2-9d35-c2605e8dec3b tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:34.158657 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-99fbfd99-c71f-44b2-9d35-c2605e8dec3b tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:34.290039 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-99fbfd99-c71f-44b2-9d35-c2605e8dec3b tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:34.297629 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-99fbfd99-c71f-44b2-9d35-c2605e8dec3b tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1260 microversion: 2.1 time: 0.152503 Aug 07 22:41:34.298192 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 213/447] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:34 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:34.765162 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-3564f168-cdd1-4897-98a7-7a86dc37b628 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:34.765787 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-3564f168-cdd1-4897-98a7-7a86dc37b628 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:34.772368 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3564f168-cdd1-4897-98a7-7a86dc37b628 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:34.772853 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3564f168-cdd1-4897-98a7-7a86dc37b628 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:34.773284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3564f168-cdd1-4897-98a7-7a86dc37b628 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:34.773972 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3564f168-cdd1-4897-98a7-7a86dc37b628 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:34.774422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3564f168-cdd1-4897-98a7-7a86dc37b628 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:34.774840 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3564f168-cdd1-4897-98a7-7a86dc37b628 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:34.806013 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-e637aec6-b0d0-4688-9cc5-5ca568e40601 req-6cf28602-9471-4edf-802f-4935710d05fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93991d13-4c43-4e03-9031-2d5032989994", "name": "network-vif-plugged", "status": "completed", "tag": "2b5b8b0f-84c3-482a-be06-dd81e2a229e1"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:41:34.815600 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-e637aec6-b0d0-4688-9cc5-5ca568e40601 req-6cf28602-9471-4edf-802f-4935710d05fe service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:34.816337 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-e637aec6-b0d0-4688-9cc5-5ca568e40601 req-6cf28602-9471-4edf-802f-4935710d05fe service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:34.816763 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-e637aec6-b0d0-4688-9cc5-5ca568e40601 req-6cf28602-9471-4edf-802f-4935710d05fe service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:34.828826 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-e637aec6-b0d0-4688-9cc5-5ca568e40601 req-6cf28602-9471-4edf-802f-4935710d05fe service nova] Creating event network-vif-plugged:2b5b8b0f-84c3-482a-be06-dd81e2a229e1 for instance 93991d13-4c43-4e03-9031-2d5032989994 on hv-cinder-85032 Aug 07 22:41:34.834091 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-e637aec6-b0d0-4688-9cc5-5ca568e40601 req-6cf28602-9471-4edf-802f-4935710d05fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032861 Aug 07 22:41:34.834699 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 214/448] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:41:34.905690 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-3564f168-cdd1-4897-98a7-7a86dc37b628 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:34.914578 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-3564f168-cdd1-4897-98a7-7a86dc37b628 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1734 microversion: 2.1 time: 0.153276 Aug 07 22:41:34.915152 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 235/449] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:34 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:35.187603 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-c279290a-ca52-4149-a8b2-06ba630a0b20 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-548226257", "imageRef": "91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8", "flavorRef": "452", "networks": [{"uuid": "7a262e81-b8e7-4431-9b78-e1d6df4bd6f9"}]}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:41:35.244792 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.network.neutron [None req-c279290a-ca52-4149-a8b2-06ba630a0b20 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] validate_networks() for [('7a262e81-b8e7-4431-9b78-e1d6df4bd6f9', None, None, None, None, None)] {{(pid=129965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 22:41:35.317685 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-01075129-6bee-429d-b78e-d192960949d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:35.318444 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-01075129-6bee-429d-b78e-d192960949d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:35.324310 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-01075129-6bee-429d-b78e-d192960949d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:35.324863 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-01075129-6bee-429d-b78e-d192960949d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:35.325391 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-01075129-6bee-429d-b78e-d192960949d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:35.326252 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-01075129-6bee-429d-b78e-d192960949d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:35.326775 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-01075129-6bee-429d-b78e-d192960949d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:35.327209 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-01075129-6bee-429d-b78e-d192960949d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:35.550673 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-01075129-6bee-429d-b78e-d192960949d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:35.558067 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-01075129-6bee-429d-b78e-d192960949d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1260 microversion: 2.1 time: 0.244298 Aug 07 22:41:35.558625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 236/450] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:35 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1260 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:35.671341 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-c279290a-ca52-4149-a8b2-06ba630a0b20 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Flavor limits 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 22:41:35.671756 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-c279290a-ca52-4149-a8b2-06ba630a0b20 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Image limits 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 22:41:35.672256 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-c279290a-ca52-4149-a8b2-06ba630a0b20 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Flavor pref 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 22:41:35.672658 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-c279290a-ca52-4149-a8b2-06ba630a0b20 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Image pref 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 22:41:35.673058 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-c279290a-ca52-4149-a8b2-06ba630a0b20 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 22:41:35.681675 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c279290a-ca52-4149-a8b2-06ba630a0b20 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:35.682143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c279290a-ca52-4149-a8b2-06ba630a0b20 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:35.682567 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c279290a-ca52-4149-a8b2-06ba630a0b20 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:35.683277 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c279290a-ca52-4149-a8b2-06ba630a0b20 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:35.683719 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c279290a-ca52-4149-a8b2-06ba630a0b20 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:35.684165 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c279290a-ca52-4149-a8b2-06ba630a0b20 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:35.701067 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-c279290a-ca52-4149-a8b2-06ba630a0b20 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Getting quotas for project 5eea609cee794549a2c23cdb24fbb572. Resources: {'cores', 'instances', 'ram'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:41:35.705021 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-c279290a-ca52-4149-a8b2-06ba630a0b20 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Getting quotas for user def1da13ff2a47ada8e5f453061e3f7c and project 5eea609cee794549a2c23cdb24fbb572. Resources: {'cores', 'instances', 'ram'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:41:35.716152 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-c279290a-ca52-4149-a8b2-06ba630a0b20 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Going to run 1 instances... {{(pid=129965) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 22:41:35.718420 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-c279290a-ca52-4149-a8b2-06ba630a0b20 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: bafeccc8-8054-4e8c-8b20-e439424892a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 22:41:35.832760 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-c279290a-ca52-4149-a8b2-06ba630a0b20 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.650000 Aug 07 22:41:35.833993 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 215/451] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 22:41:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 22:41:35.844771 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-21a81e71-d61b-42df-8bca-ce6eb39779cd tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:35.845381 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-21a81e71-d61b-42df-8bca-ce6eb39779cd tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: bafeccc8-8054-4e8c-8b20-e439424892a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:35.848841 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:35.899949 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-21a81e71-d61b-42df-8bca-ce6eb39779cd tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:35.906937 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-21a81e71-d61b-42df-8bca-ce6eb39779cd tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7" status: 200 len: 1218 microversion: 2.1 time: 0.066060 Aug 07 22:41:35.907568 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 237/452] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:35 2022] GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:35.936047 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d398ae71-9f6e-44ba-90f9-7016ed5c450d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:35.936659 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-d398ae71-9f6e-44ba-90f9-7016ed5c450d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:35.944284 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d398ae71-9f6e-44ba-90f9-7016ed5c450d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:35.944834 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d398ae71-9f6e-44ba-90f9-7016ed5c450d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:35.945269 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d398ae71-9f6e-44ba-90f9-7016ed5c450d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:35.945953 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d398ae71-9f6e-44ba-90f9-7016ed5c450d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:35.946397 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d398ae71-9f6e-44ba-90f9-7016ed5c450d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:35.946811 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d398ae71-9f6e-44ba-90f9-7016ed5c450d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:36.089357 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-d398ae71-9f6e-44ba-90f9-7016ed5c450d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:36.097383 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-d398ae71-9f6e-44ba-90f9-7016ed5c450d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1734 microversion: 2.1 time: 0.165183 Aug 07 22:41:36.097949 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 216/453] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:35 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:36.579480 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a7b5d046-0a3a-4d3c-a375-97dcd138ae98 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:36.580167 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a7b5d046-0a3a-4d3c-a375-97dcd138ae98 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:36.588027 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a7b5d046-0a3a-4d3c-a375-97dcd138ae98 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:36.588550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a7b5d046-0a3a-4d3c-a375-97dcd138ae98 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:36.588976 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a7b5d046-0a3a-4d3c-a375-97dcd138ae98 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:36.589660 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a7b5d046-0a3a-4d3c-a375-97dcd138ae98 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:36.590100 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a7b5d046-0a3a-4d3c-a375-97dcd138ae98 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:36.590514 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a7b5d046-0a3a-4d3c-a375-97dcd138ae98 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:36.720759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-a7b5d046-0a3a-4d3c-a375-97dcd138ae98 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:36.728229 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a7b5d046-0a3a-4d3c-a375-97dcd138ae98 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1260 microversion: 2.1 time: 0.152931 Aug 07 22:41:36.728778 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 238/454] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:36 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:36.927490 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-6e96024a-30e5-4efe-bda4-090059fbcdfe tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:36.928356 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-6e96024a-30e5-4efe-bda4-090059fbcdfe tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: bafeccc8-8054-4e8c-8b20-e439424892a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:36.934880 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6e96024a-30e5-4efe-bda4-090059fbcdfe tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:36.935365 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6e96024a-30e5-4efe-bda4-090059fbcdfe tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:36.935805 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6e96024a-30e5-4efe-bda4-090059fbcdfe tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:36.936526 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6e96024a-30e5-4efe-bda4-090059fbcdfe tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:36.937078 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6e96024a-30e5-4efe-bda4-090059fbcdfe tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:36.937498 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6e96024a-30e5-4efe-bda4-090059fbcdfe tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:36.999540 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-6e96024a-30e5-4efe-bda4-090059fbcdfe tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:37.008417 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-6e96024a-30e5-4efe-bda4-090059fbcdfe tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7" status: 200 len: 1222 microversion: 2.1 time: 0.085363 Aug 07 22:41:37.009285 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 217/455] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:36 2022] GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:37.119416 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-89a8b1db-d040-439d-9c00-6e997746ab74 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:37.120046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-89a8b1db-d040-439d-9c00-6e997746ab74 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:37.128301 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-89a8b1db-d040-439d-9c00-6e997746ab74 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:37.129167 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-89a8b1db-d040-439d-9c00-6e997746ab74 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:37.129331 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-89a8b1db-d040-439d-9c00-6e997746ab74 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:37.130627 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-89a8b1db-d040-439d-9c00-6e997746ab74 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:37.131235 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-89a8b1db-d040-439d-9c00-6e997746ab74 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:37.131655 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-89a8b1db-d040-439d-9c00-6e997746ab74 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:37.266073 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-89a8b1db-d040-439d-9c00-6e997746ab74 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:37.274395 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-89a8b1db-d040-439d-9c00-6e997746ab74 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1734 microversion: 2.1 time: 0.159005 Aug 07 22:41:37.275004 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 239/456] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:37 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:37.748144 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d44d551b-7935-4b91-9db6-0986af961f6c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:37.748755 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-d44d551b-7935-4b91-9db6-0986af961f6c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:37.754736 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d44d551b-7935-4b91-9db6-0986af961f6c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:37.755556 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d44d551b-7935-4b91-9db6-0986af961f6c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:37.756168 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d44d551b-7935-4b91-9db6-0986af961f6c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:37.756913 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d44d551b-7935-4b91-9db6-0986af961f6c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:37.757306 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d44d551b-7935-4b91-9db6-0986af961f6c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:37.757735 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d44d551b-7935-4b91-9db6-0986af961f6c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:37.773467 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=100 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:37.947384 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-d44d551b-7935-4b91-9db6-0986af961f6c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:37.955247 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-d44d551b-7935-4b91-9db6-0986af961f6c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1445 microversion: 2.1 time: 0.211019 Aug 07 22:41:37.955813 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 218/457] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:37 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1445 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:37.977121 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-01a088e5-d2e7-4513-b83e-3999906359a8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:37.977755 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-01a088e5-d2e7-4513-b83e-3999906359a8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:37.983791 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-01a088e5-d2e7-4513-b83e-3999906359a8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:37.984303 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-01a088e5-d2e7-4513-b83e-3999906359a8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:37.984769 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-01a088e5-d2e7-4513-b83e-3999906359a8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:37.985414 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-01a088e5-d2e7-4513-b83e-3999906359a8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:37.985863 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-01a088e5-d2e7-4513-b83e-3999906359a8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:37.986279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-01a088e5-d2e7-4513-b83e-3999906359a8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:38.029150 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-3b1136b0-aa0a-47c0-9675-542fe7291420 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:38.029812 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-3b1136b0-aa0a-47c0-9675-542fe7291420 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: bafeccc8-8054-4e8c-8b20-e439424892a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:38.035982 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3b1136b0-aa0a-47c0-9675-542fe7291420 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:38.036595 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3b1136b0-aa0a-47c0-9675-542fe7291420 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:38.037027 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3b1136b0-aa0a-47c0-9675-542fe7291420 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:38.037759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3b1136b0-aa0a-47c0-9675-542fe7291420 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:38.038159 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3b1136b0-aa0a-47c0-9675-542fe7291420 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:38.038590 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3b1136b0-aa0a-47c0-9675-542fe7291420 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:38.122828 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-3b1136b0-aa0a-47c0-9675-542fe7291420 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:38.131055 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-3b1136b0-aa0a-47c0-9675-542fe7291420 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7" status: 200 len: 1288 microversion: 2.1 time: 0.105091 Aug 07 22:41:38.131633 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 219/458] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:38 2022] GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7 => generated 1288 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:41:38.215251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-01a088e5-d2e7-4513-b83e-3999906359a8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:38.222943 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-01a088e5-d2e7-4513-b83e-3999906359a8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1445 microversion: 2.1 time: 0.249958 Aug 07 22:41:38.224204 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 240/459] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:37 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1445 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:41:38.296363 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7e6e33c3-302f-45a0-b0f9-2a19b4f699a9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:38.297129 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-7e6e33c3-302f-45a0-b0f9-2a19b4f699a9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:38.303937 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7e6e33c3-302f-45a0-b0f9-2a19b4f699a9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:38.304587 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7e6e33c3-302f-45a0-b0f9-2a19b4f699a9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:38.305140 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7e6e33c3-302f-45a0-b0f9-2a19b4f699a9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:38.305939 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7e6e33c3-302f-45a0-b0f9-2a19b4f699a9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:38.306494 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7e6e33c3-302f-45a0-b0f9-2a19b4f699a9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:38.307025 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7e6e33c3-302f-45a0-b0f9-2a19b4f699a9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:38.772995 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7e6e33c3-302f-45a0-b0f9-2a19b4f699a9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:38.781672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-7e6e33c3-302f-45a0-b0f9-2a19b4f699a9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1734 microversion: 2.1 time: 0.489269 Aug 07 22:41:38.792067 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 220/460] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:38 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1734 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:39.152866 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-7af3fe7c-ae80-463d-80f7-b5fcd0015a8a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:39.153393 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-7af3fe7c-ae80-463d-80f7-b5fcd0015a8a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: bafeccc8-8054-4e8c-8b20-e439424892a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:39.159743 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7af3fe7c-ae80-463d-80f7-b5fcd0015a8a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:39.169575 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7af3fe7c-ae80-463d-80f7-b5fcd0015a8a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:39.169575 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7af3fe7c-ae80-463d-80f7-b5fcd0015a8a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:39.169575 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7af3fe7c-ae80-463d-80f7-b5fcd0015a8a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:39.169575 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7af3fe7c-ae80-463d-80f7-b5fcd0015a8a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:39.169979 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7af3fe7c-ae80-463d-80f7-b5fcd0015a8a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:39.360913 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-7af3fe7c-ae80-463d-80f7-b5fcd0015a8a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:39.372469 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-7af3fe7c-ae80-463d-80f7-b5fcd0015a8a tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7" status: 200 len: 1318 microversion: 2.1 time: 0.223244 Aug 07 22:41:39.373279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 241/461] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:39 2022] GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:39.804662 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-12620824-4757-4365-b9a8-0df05b7bf4b9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:39.805668 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-12620824-4757-4365-b9a8-0df05b7bf4b9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:39.811962 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-12620824-4757-4365-b9a8-0df05b7bf4b9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:39.812599 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-12620824-4757-4365-b9a8-0df05b7bf4b9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:39.813039 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-12620824-4757-4365-b9a8-0df05b7bf4b9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:39.813735 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-12620824-4757-4365-b9a8-0df05b7bf4b9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:39.814219 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-12620824-4757-4365-b9a8-0df05b7bf4b9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:39.814646 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-12620824-4757-4365-b9a8-0df05b7bf4b9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:40.011635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-12620824-4757-4365-b9a8-0df05b7bf4b9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:40.022492 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-12620824-4757-4365-b9a8-0df05b7bf4b9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1734 microversion: 2.1 time: 0.222160 Aug 07 22:41:40.029386 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 221/462] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:39 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1734 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:40.135659 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-f910cb42-2518-47af-acb5-d71751db6cd5 req-88c73ae4-26bd-4d67-aa3e-bb42029d3cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bafeccc8-8054-4e8c-8b20-e439424892a7", "tag": "176ad337-d4eb-4601-aa99-1635af97d649"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:41:40.145178 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-f910cb42-2518-47af-acb5-d71751db6cd5 req-88c73ae4-26bd-4d67-aa3e-bb42029d3cd8 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:40.146181 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-f910cb42-2518-47af-acb5-d71751db6cd5 req-88c73ae4-26bd-4d67-aa3e-bb42029d3cd8 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:40.146619 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-f910cb42-2518-47af-acb5-d71751db6cd5 req-88c73ae4-26bd-4d67-aa3e-bb42029d3cd8 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:40.157998 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-f910cb42-2518-47af-acb5-d71751db6cd5 req-88c73ae4-26bd-4d67-aa3e-bb42029d3cd8 service nova] Creating event network-changed:176ad337-d4eb-4601-aa99-1635af97d649 for instance bafeccc8-8054-4e8c-8b20-e439424892a7 on hv-cinder-85032 Aug 07 22:41:40.163728 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-f910cb42-2518-47af-acb5-d71751db6cd5 req-88c73ae4-26bd-4d67-aa3e-bb42029d3cd8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031956 Aug 07 22:41:40.164387 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 242/463] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:41:40.394560 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-b893d954-05e1-44fb-9154-5d7ae2391270 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:40.395194 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-b893d954-05e1-44fb-9154-5d7ae2391270 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: bafeccc8-8054-4e8c-8b20-e439424892a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:40.402561 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b893d954-05e1-44fb-9154-5d7ae2391270 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:40.403034 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b893d954-05e1-44fb-9154-5d7ae2391270 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:40.403483 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b893d954-05e1-44fb-9154-5d7ae2391270 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:40.404174 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b893d954-05e1-44fb-9154-5d7ae2391270 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:40.404620 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b893d954-05e1-44fb-9154-5d7ae2391270 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:40.405035 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b893d954-05e1-44fb-9154-5d7ae2391270 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:40.614611 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-5994818d-dbb9-4c24-916e-77fcbb1e9e2a req-76dad6a4-15fa-4aa8-94f2-d040b06e0b1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93991d13-4c43-4e03-9031-2d5032989994", "tag": "2b5b8b0f-84c3-482a-be06-dd81e2a229e1"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:41:40.619169 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-5994818d-dbb9-4c24-916e-77fcbb1e9e2a req-76dad6a4-15fa-4aa8-94f2-d040b06e0b1c service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:40.619680 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-5994818d-dbb9-4c24-916e-77fcbb1e9e2a req-76dad6a4-15fa-4aa8-94f2-d040b06e0b1c service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:40.620345 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-5994818d-dbb9-4c24-916e-77fcbb1e9e2a req-76dad6a4-15fa-4aa8-94f2-d040b06e0b1c service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:40.632665 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-5994818d-dbb9-4c24-916e-77fcbb1e9e2a req-76dad6a4-15fa-4aa8-94f2-d040b06e0b1c service nova] Creating event network-changed:2b5b8b0f-84c3-482a-be06-dd81e2a229e1 for instance 93991d13-4c43-4e03-9031-2d5032989994 on hv-cinder-85032 Aug 07 22:41:40.639677 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-5994818d-dbb9-4c24-916e-77fcbb1e9e2a req-76dad6a4-15fa-4aa8-94f2-d040b06e0b1c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036140 Aug 07 22:41:40.640864 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 243/464] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:41:40.669575 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-b893d954-05e1-44fb-9154-5d7ae2391270 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:40.687169 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-b893d954-05e1-44fb-9154-5d7ae2391270 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7" status: 200 len: 1318 microversion: 2.1 time: 0.296418 Aug 07 22:41:40.687982 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 222/465] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:40 2022] GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:41.046055 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b2744042-e163-494e-8acd-f6093696513a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:41.046845 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-b2744042-e163-494e-8acd-f6093696513a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:41.053755 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b2744042-e163-494e-8acd-f6093696513a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:41.054636 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b2744042-e163-494e-8acd-f6093696513a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:41.055069 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b2744042-e163-494e-8acd-f6093696513a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:41.056144 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b2744042-e163-494e-8acd-f6093696513a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:41.056792 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b2744042-e163-494e-8acd-f6093696513a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:41.057354 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b2744042-e163-494e-8acd-f6093696513a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:41.074075 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=100 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:41.260139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-b2744042-e163-494e-8acd-f6093696513a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:41.268920 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-b2744042-e163-494e-8acd-f6093696513a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1734 microversion: 2.1 time: 0.227690 Aug 07 22:41:41.269621 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 244/466] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:41 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1734 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:41.708527 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-c0bda53e-aabf-4bdf-b5c3-4b8116083630 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:41.709065 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-c0bda53e-aabf-4bdf-b5c3-4b8116083630 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: bafeccc8-8054-4e8c-8b20-e439424892a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:41.715532 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c0bda53e-aabf-4bdf-b5c3-4b8116083630 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:41.716474 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c0bda53e-aabf-4bdf-b5c3-4b8116083630 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:41.716474 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c0bda53e-aabf-4bdf-b5c3-4b8116083630 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:41.717153 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c0bda53e-aabf-4bdf-b5c3-4b8116083630 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:41.717592 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c0bda53e-aabf-4bdf-b5c3-4b8116083630 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:41.718008 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c0bda53e-aabf-4bdf-b5c3-4b8116083630 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:41.925764 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-c0bda53e-aabf-4bdf-b5c3-4b8116083630 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:41.933222 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-c0bda53e-aabf-4bdf-b5c3-4b8116083630 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7" status: 200 len: 1318 microversion: 2.1 time: 0.229226 Aug 07 22:41:41.933790 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 223/467] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:41 2022] GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:42.290900 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-e205b481-d117-46fb-a060-53277bdaf554 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:42.291542 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-e205b481-d117-46fb-a060-53277bdaf554 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:42.298044 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e205b481-d117-46fb-a060-53277bdaf554 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:42.298531 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e205b481-d117-46fb-a060-53277bdaf554 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:42.298997 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e205b481-d117-46fb-a060-53277bdaf554 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:42.299689 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e205b481-d117-46fb-a060-53277bdaf554 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:42.300267 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e205b481-d117-46fb-a060-53277bdaf554 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:42.300696 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e205b481-d117-46fb-a060-53277bdaf554 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:42.434007 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-e205b481-d117-46fb-a060-53277bdaf554 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:42.441977 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-e205b481-d117-46fb-a060-53277bdaf554 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1734 microversion: 2.1 time: 0.155057 Aug 07 22:41:42.443361 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 245/468] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:42 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:42.954087 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-5d566271-f14e-4b58-b3bf-70f56dcc83a6 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:42.954727 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-5d566271-f14e-4b58-b3bf-70f56dcc83a6 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: bafeccc8-8054-4e8c-8b20-e439424892a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:42.961799 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5d566271-f14e-4b58-b3bf-70f56dcc83a6 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:42.962276 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5d566271-f14e-4b58-b3bf-70f56dcc83a6 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:42.962709 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5d566271-f14e-4b58-b3bf-70f56dcc83a6 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:42.963389 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5d566271-f14e-4b58-b3bf-70f56dcc83a6 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:42.963836 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5d566271-f14e-4b58-b3bf-70f56dcc83a6 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:42.964322 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5d566271-f14e-4b58-b3bf-70f56dcc83a6 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:43.095622 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-5d566271-f14e-4b58-b3bf-70f56dcc83a6 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:43.103723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-5d566271-f14e-4b58-b3bf-70f56dcc83a6 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7" status: 200 len: 1318 microversion: 2.1 time: 0.153478 Aug 07 22:41:43.104313 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 224/469] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:42 2022] GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:43.464970 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-d94590e4-511b-4c09-91a2-dd088a50eb5d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:43.465575 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-d94590e4-511b-4c09-91a2-dd088a50eb5d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:43.472361 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d94590e4-511b-4c09-91a2-dd088a50eb5d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:43.472837 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d94590e4-511b-4c09-91a2-dd088a50eb5d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:43.473272 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d94590e4-511b-4c09-91a2-dd088a50eb5d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:43.474178 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d94590e4-511b-4c09-91a2-dd088a50eb5d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:43.474669 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d94590e4-511b-4c09-91a2-dd088a50eb5d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:43.475087 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d94590e4-511b-4c09-91a2-dd088a50eb5d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:43.603004 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-d94590e4-511b-4c09-91a2-dd088a50eb5d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:43.610889 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-d94590e4-511b-4c09-91a2-dd088a50eb5d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1714 microversion: 2.1 time: 0.149820 Aug 07 22:41:43.611455 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 246/470] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:43 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1714 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:43.718614 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-be33677c-618e-4314-b0dd-20840ceb272c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:43.719024 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-be33677c-618e-4314-b0dd-20840ceb272c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:43.725222 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-be33677c-618e-4314-b0dd-20840ceb272c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:43.725693 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-be33677c-618e-4314-b0dd-20840ceb272c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:43.726121 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-be33677c-618e-4314-b0dd-20840ceb272c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:43.726804 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-be33677c-618e-4314-b0dd-20840ceb272c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:43.727253 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-be33677c-618e-4314-b0dd-20840ceb272c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:43.727672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-be33677c-618e-4314-b0dd-20840ceb272c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:43.848286 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.wsgi [None req-be33677c-618e-4314-b0dd-20840ceb272c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] HTTP exception thrown: Cannot 'detach_volume' instance 62959a95-0c79-4d83-a375-147271e53ffa while it is in vm_state rescued Aug 07 22:41:43.850626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-be33677c-618e-4314-b0dd-20840ceb272c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Request method failure captured: Aug 07 22:41:43.850626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: request: DELETE /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa/os-volume_attachments/d0058be8-4f43-47bb-beec-e4224e99a5a7 HTTP/1.1 Aug 07 22:41:43.850626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept: application/json Aug 07 22:41:43.850626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept-Encoding: identity Aug 07 22:41:43.850626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Connection: close Aug 07 22:41:43.850626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Length: 0 Aug 07 22:41:43.850626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Type: application/json Aug 07 22:41:43.850626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Host: 10.222.0.30 Aug 07 22:41:43.850626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Openstack-System-Scope: None Aug 07 22:41:43.850626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: User-Agent: python-urllib3/1.26.11 Aug 07 22:41:43.850626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Auth-Token: gAAAAABi8D6s5nO1c7U2MmqVI63h0n43WSrk5CGbs2YynnGh_TABx-q8rxIYvsMGcCP7Nv7JfrcY16P7N3JNnFncFS0_mt8rJCMseLlgBlfUb-RWx8wwGc9OQ2mOe8HxAwiKpQ0fBBAk_n596Ofhngwl4r_Hz2hQEOMQxV8vDBZueD9nBUbzfMg Aug 07 22:41:43.850626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Id: None Aug 07 22:41:43.850626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Name: None Aug 07 22:41:43.850626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Identity-Status: Confirmed Aug 07 22:41:43.850626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Is-Admin-Project: True Aug 07 22:41:43.850626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Id: default Aug 07 22:41:43.850626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Name: Default Aug 07 22:41:43.850626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Id: 1a78ad9d7151473798fbefa330678250 Aug 07 22:41:43.850626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-755269189 Aug 07 22:41:43.850626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Role: reader,member Aug 07 22:41:43.850626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Roles: reader,member Aug 07 22:41:43.852157 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1a78ad9d7151473798fbefa330678250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1a78ad9d7151473798fbefa330678250"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1a78ad9d7151473798fbefa330678250"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1a78ad9d7151473798fbefa330678250"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:41:43.852157 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant: tempest-ServerRescueNegativeTestJSON-755269189 Aug 07 22:41:43.852157 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Id: 1a78ad9d7151473798fbefa330678250 Aug 07 22:41:43.852157 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-755269189 Aug 07 22:41:43.852157 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User: tempest-ServerRescueNegativeTestJSON-755269189-project Aug 07 22:41:43.852157 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Id: default Aug 07 22:41:43.852157 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Name: Default Aug 07 22:41:43.852157 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Id: 966045fbe69f43b4b1a825da3ad571b9 Aug 07 22:41:43.852157 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Name: tempest-ServerRescueNegativeTestJSON-755269189-project Aug 07 22:41:43.852157 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: method: > Aug 07 22:41:43.852157 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: exception: Cannot 'detach_volume' instance 62959a95-0c79-4d83-a375-147271e53ffa while it is in vm_state rescued Aug 07 22:41:43.853018 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: action_args: {'server_id': '62959a95-0c79-4d83-a375-147271e53ffa', 'id': 'd0058be8-4f43-47bb-beec-e4224e99a5a7'} Aug 07 22:41:43.853018 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:41:43.853018 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:41:43.853018 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 07 22:41:43.853018 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 07 22:41:43.853018 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 22:41:43.853018 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 22:41:43.853018 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 07 22:41:43.853018 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 07 22:41:43.853018 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 62959a95-0c79-4d83-a375-147271e53ffa in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 07 22:41:43.853018 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:41:43.853018 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:41:43.853018 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:41:43.853018 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:41:43.853018 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:41:43.853018 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:41:43.853018 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:41:43.853018 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:41:43.853018 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:41:43.853018 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:41:43.854546 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 07 22:41:43.854546 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 07 22:41:43.854546 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 07 22:41:43.854546 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 07 22:41:43.854546 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 62959a95-0c79-4d83-a375-147271e53ffa while it is in vm_state rescued Aug 07 22:41:43.854546 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:41:43.854546 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:41:43.854546 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:41:43.854546 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:41:43.854546 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:41:43.854546 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:41:43.854546 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:41:43.854546 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:41:43.854546 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 62959a95-0c79-4d83-a375-147271e53ffa while it is in vm_state rescued Aug 07 22:41:43.854546 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:41:43.854546 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-be33677c-618e-4314-b0dd-20840ceb272c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Returning 409 to user: Cannot 'detach_volume' instance 62959a95-0c79-4d83-a375-147271e53ffa while it is in vm_state rescued {{(pid=129965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:41:43.855801 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-be33677c-618e-4314-b0dd-20840ceb272c tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "DELETE /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa/os-volume_attachments/d0058be8-4f43-47bb-beec-e4224e99a5a7" status: 409 len: 152 microversion: 2.1 time: 0.137542 Aug 07 22:41:43.855801 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 225/471] 10.222.0.30 () {58 vars in 1416 bytes} [Sun Aug 7 22:41:43 2022] DELETE /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa/os-volume_attachments/d0058be8-4f43-47bb-beec-e4224e99a5a7 => generated 152 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 22:41:43.860922 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-407f2242-0539-4e98-aba4-d77d3fbf1c12 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:41:43.861448 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-407f2242-0539-4e98-aba4-d77d3fbf1c12 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:43.867312 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-407f2242-0539-4e98-aba4-d77d3fbf1c12 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:43.867768 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-407f2242-0539-4e98-aba4-d77d3fbf1c12 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:43.868233 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-407f2242-0539-4e98-aba4-d77d3fbf1c12 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:43.868912 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-407f2242-0539-4e98-aba4-d77d3fbf1c12 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:43.869372 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-407f2242-0539-4e98-aba4-d77d3fbf1c12 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:43.869786 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-407f2242-0539-4e98-aba4-d77d3fbf1c12 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:44.062527 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-407f2242-0539-4e98-aba4-d77d3fbf1c12 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "POST /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa/action" status: 202 len: 0 microversion: 2.1 time: 0.205308 Aug 07 22:41:44.063227 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 247/472] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 22:41:43 2022] POST /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:41:44.071284 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-a3bf4d50-6633-4c72-b0e6-f6d17e98d448 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:44.071894 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-a3bf4d50-6633-4c72-b0e6-f6d17e98d448 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:44.079635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a3bf4d50-6633-4c72-b0e6-f6d17e98d448 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:44.080390 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a3bf4d50-6633-4c72-b0e6-f6d17e98d448 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:44.080824 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a3bf4d50-6633-4c72-b0e6-f6d17e98d448 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:44.081516 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a3bf4d50-6633-4c72-b0e6-f6d17e98d448 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:44.082179 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a3bf4d50-6633-4c72-b0e6-f6d17e98d448 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:44.082605 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a3bf4d50-6633-4c72-b0e6-f6d17e98d448 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:44.124734 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-58127b08-d099-4dba-973c-bac274ca18fd tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:44.125429 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-58127b08-d099-4dba-973c-bac274ca18fd tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: bafeccc8-8054-4e8c-8b20-e439424892a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:44.131717 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-58127b08-d099-4dba-973c-bac274ca18fd tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:44.132236 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-58127b08-d099-4dba-973c-bac274ca18fd tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:44.132675 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-58127b08-d099-4dba-973c-bac274ca18fd tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:44.133371 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-58127b08-d099-4dba-973c-bac274ca18fd tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:44.133847 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-58127b08-d099-4dba-973c-bac274ca18fd tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:44.134250 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-58127b08-d099-4dba-973c-bac274ca18fd tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:44.361959 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-a3bf4d50-6633-4c72-b0e6-f6d17e98d448 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:44.370465 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-a3bf4d50-6633-4c72-b0e6-f6d17e98d448 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1722 microversion: 2.1 time: 0.303010 Aug 07 22:41:44.371032 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 226/473] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:44 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1722 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:44.397386 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-58127b08-d099-4dba-973c-bac274ca18fd tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:44.405481 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-58127b08-d099-4dba-973c-bac274ca18fd tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7" status: 200 len: 1318 microversion: 2.1 time: 0.284865 Aug 07 22:41:44.406047 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 248/474] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:44 2022] GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:41:45.391008 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-605cc86d-cb4f-48c9-87da-0c9bcc8ab9df tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:45.391606 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-605cc86d-cb4f-48c9-87da-0c9bcc8ab9df tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:45.398707 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-605cc86d-cb4f-48c9-87da-0c9bcc8ab9df tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:45.399194 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-605cc86d-cb4f-48c9-87da-0c9bcc8ab9df tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:45.400656 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-605cc86d-cb4f-48c9-87da-0c9bcc8ab9df tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:45.401360 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-605cc86d-cb4f-48c9-87da-0c9bcc8ab9df tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:45.401844 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-605cc86d-cb4f-48c9-87da-0c9bcc8ab9df tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:45.402273 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-605cc86d-cb4f-48c9-87da-0c9bcc8ab9df tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:45.426506 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-4c952cdd-1936-4369-8dca-fec1339ee256 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:45.427317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-4c952cdd-1936-4369-8dca-fec1339ee256 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: bafeccc8-8054-4e8c-8b20-e439424892a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:45.434389 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4c952cdd-1936-4369-8dca-fec1339ee256 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:45.438143 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4c952cdd-1936-4369-8dca-fec1339ee256 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:45.438143 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4c952cdd-1936-4369-8dca-fec1339ee256 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:45.438143 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4c952cdd-1936-4369-8dca-fec1339ee256 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:45.438143 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4c952cdd-1936-4369-8dca-fec1339ee256 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:45.438539 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4c952cdd-1936-4369-8dca-fec1339ee256 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:45.588722 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-605cc86d-cb4f-48c9-87da-0c9bcc8ab9df tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:45.596511 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-605cc86d-cb4f-48c9-87da-0c9bcc8ab9df tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1722 microversion: 2.1 time: 0.209464 Aug 07 22:41:45.597340 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 227/475] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:45 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:45.610929 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-4c952cdd-1936-4369-8dca-fec1339ee256 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:45.618713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-4c952cdd-1936-4369-8dca-fec1339ee256 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7" status: 200 len: 1318 microversion: 2.1 time: 0.196229 Aug 07 22:41:45.619268 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 249/476] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:45 2022] GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:41:46.618073 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-9b0f5691-9cb2-4b9c-b03d-19ec81e2fb51 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:46.618711 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-9b0f5691-9cb2-4b9c-b03d-19ec81e2fb51 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:46.620610 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=2 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:46.621264 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=6 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:46.622403 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:46.627225 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9b0f5691-9cb2-4b9c-b03d-19ec81e2fb51 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:46.627821 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9b0f5691-9cb2-4b9c-b03d-19ec81e2fb51 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:46.628407 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9b0f5691-9cb2-4b9c-b03d-19ec81e2fb51 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:46.629170 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9b0f5691-9cb2-4b9c-b03d-19ec81e2fb51 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:46.629622 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9b0f5691-9cb2-4b9c-b03d-19ec81e2fb51 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:46.630048 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9b0f5691-9cb2-4b9c-b03d-19ec81e2fb51 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:46.642166 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-5bd9faca-9133-4791-be71-f015a582729b tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:46.651847 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-5bd9faca-9133-4791-be71-f015a582729b tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: bafeccc8-8054-4e8c-8b20-e439424892a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:46.651847 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=2 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:46.651847 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5bd9faca-9133-4791-be71-f015a582729b tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:46.651847 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5bd9faca-9133-4791-be71-f015a582729b tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:46.652309 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5bd9faca-9133-4791-be71-f015a582729b tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:46.653027 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5bd9faca-9133-4791-be71-f015a582729b tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:46.653340 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5bd9faca-9133-4791-be71-f015a582729b tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:46.653764 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5bd9faca-9133-4791-be71-f015a582729b tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:46.842476 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-9b0f5691-9cb2-4b9c-b03d-19ec81e2fb51 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:46.845773 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-5bd9faca-9133-4791-be71-f015a582729b tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:46.856357 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-9b0f5691-9cb2-4b9c-b03d-19ec81e2fb51 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1722 microversion: 2.1 time: 0.242666 Aug 07 22:41:46.868100 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-5bd9faca-9133-4791-be71-f015a582729b tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7" status: 200 len: 1318 microversion: 2.1 time: 0.218980 Aug 07 22:41:46.868263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 228/477] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:46 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:46.868356 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 250/478] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:46 2022] GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:46.868441 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-8ef7dfad-c93c-42c8-9981-fb1c9eacbd07 req-c0887473-4390-49e6-84d1-5048b1662df0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bafeccc8-8054-4e8c-8b20-e439424892a7", "name": "network-vif-plugged", "status": "completed", "tag": "176ad337-d4eb-4601-aa99-1635af97d649"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:41:46.871266 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-8ef7dfad-c93c-42c8-9981-fb1c9eacbd07 req-c0887473-4390-49e6-84d1-5048b1662df0 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:46.871742 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-8ef7dfad-c93c-42c8-9981-fb1c9eacbd07 req-c0887473-4390-49e6-84d1-5048b1662df0 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:46.872199 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-8ef7dfad-c93c-42c8-9981-fb1c9eacbd07 req-c0887473-4390-49e6-84d1-5048b1662df0 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:46.883100 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-8ef7dfad-c93c-42c8-9981-fb1c9eacbd07 req-c0887473-4390-49e6-84d1-5048b1662df0 service nova] Creating event network-vif-plugged:176ad337-d4eb-4601-aa99-1635af97d649 for instance bafeccc8-8054-4e8c-8b20-e439424892a7 on hv-cinder-85032 Aug 07 22:41:46.888283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-8ef7dfad-c93c-42c8-9981-fb1c9eacbd07 req-c0887473-4390-49e6-84d1-5048b1662df0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029927 Aug 07 22:41:46.888852 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 229/479] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:41:47.878170 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b25a8a09-0516-438e-a1e8-4df67330aa4c tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:47.878765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-b25a8a09-0516-438e-a1e8-4df67330aa4c tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: bafeccc8-8054-4e8c-8b20-e439424892a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:47.879153 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-3af2613e-3034-480d-9103-8e16733b7acb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:47.879844 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-3af2613e-3034-480d-9103-8e16733b7acb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:47.886125 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b25a8a09-0516-438e-a1e8-4df67330aa4c tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:47.886604 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b25a8a09-0516-438e-a1e8-4df67330aa4c tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:47.886719 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3af2613e-3034-480d-9103-8e16733b7acb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:47.887036 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b25a8a09-0516-438e-a1e8-4df67330aa4c tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:47.887142 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3af2613e-3034-480d-9103-8e16733b7acb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:47.887543 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3af2613e-3034-480d-9103-8e16733b7acb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:47.887718 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b25a8a09-0516-438e-a1e8-4df67330aa4c tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:47.888195 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b25a8a09-0516-438e-a1e8-4df67330aa4c tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:47.888314 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3af2613e-3034-480d-9103-8e16733b7acb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:47.888615 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b25a8a09-0516-438e-a1e8-4df67330aa4c tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:47.888722 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3af2613e-3034-480d-9103-8e16733b7acb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:47.889727 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3af2613e-3034-480d-9103-8e16733b7acb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:48.086211 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-b25a8a09-0516-438e-a1e8-4df67330aa4c tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:48.089683 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-3af2613e-3034-480d-9103-8e16733b7acb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:48.093561 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-b25a8a09-0516-438e-a1e8-4df67330aa4c tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7" status: 200 len: 1318 microversion: 2.1 time: 0.219303 Aug 07 22:41:48.094138 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 251/480] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:47 2022] GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:48.097597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-3af2613e-3034-480d-9103-8e16733b7acb tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1728 microversion: 2.1 time: 0.223044 Aug 07 22:41:48.098209 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 230/481] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:47 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1728 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:41:48.118233 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-66310460-1474-4142-a7ed-6b0e89736f11 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:48.118715 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-66310460-1474-4142-a7ed-6b0e89736f11 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:48.124395 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-66310460-1474-4142-a7ed-6b0e89736f11 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:48.124866 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-66310460-1474-4142-a7ed-6b0e89736f11 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:48.125294 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-66310460-1474-4142-a7ed-6b0e89736f11 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:48.125964 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-66310460-1474-4142-a7ed-6b0e89736f11 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:48.126408 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-66310460-1474-4142-a7ed-6b0e89736f11 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:48.126823 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-66310460-1474-4142-a7ed-6b0e89736f11 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:48.202048 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-66310460-1474-4142-a7ed-6b0e89736f11 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088099 Aug 07 22:41:48.202643 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 252/482] 10.222.0.30 () {58 vars in 1275 bytes} [Sun Aug 7 22:41:48 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:41:49.114424 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-0804d749-7f60-4eee-a39a-87665a093059 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:49.115593 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-0804d749-7f60-4eee-a39a-87665a093059 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: bafeccc8-8054-4e8c-8b20-e439424892a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:49.122253 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0804d749-7f60-4eee-a39a-87665a093059 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:49.122731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0804d749-7f60-4eee-a39a-87665a093059 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:49.123196 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0804d749-7f60-4eee-a39a-87665a093059 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:49.123892 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0804d749-7f60-4eee-a39a-87665a093059 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:49.124400 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0804d749-7f60-4eee-a39a-87665a093059 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:49.124827 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0804d749-7f60-4eee-a39a-87665a093059 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:49.332129 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-0804d749-7f60-4eee-a39a-87665a093059 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:49.340516 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-0804d749-7f60-4eee-a39a-87665a093059 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7" status: 200 len: 1318 microversion: 2.1 time: 0.229792 Aug 07 22:41:49.341462 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 231/483] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:49 2022] GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:49.447083 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-9cb329a8-9222-424b-8bae-7e4e3fb43e33 req-ce0a9207-280e-4466-8042-2780fdbfcea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62959a95-0c79-4d83-a375-147271e53ffa", "tag": "ffa75a68-45f7-47ee-941b-97d714ef438e"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:41:49.457400 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-9cb329a8-9222-424b-8bae-7e4e3fb43e33 req-ce0a9207-280e-4466-8042-2780fdbfcea8 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:49.457873 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-9cb329a8-9222-424b-8bae-7e4e3fb43e33 req-ce0a9207-280e-4466-8042-2780fdbfcea8 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:49.458299 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-9cb329a8-9222-424b-8bae-7e4e3fb43e33 req-ce0a9207-280e-4466-8042-2780fdbfcea8 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:49.469446 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-9cb329a8-9222-424b-8bae-7e4e3fb43e33 req-ce0a9207-280e-4466-8042-2780fdbfcea8 service nova] Creating event network-changed:ffa75a68-45f7-47ee-941b-97d714ef438e for instance 62959a95-0c79-4d83-a375-147271e53ffa on hv-cinder-85032 Aug 07 22:41:49.474309 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-9cb329a8-9222-424b-8bae-7e4e3fb43e33 req-ce0a9207-280e-4466-8042-2780fdbfcea8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031895 Aug 07 22:41:49.475736 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 253/484] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:41:50.361958 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-05ac1ee3-b37a-4270-a823-2be786b1b854 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:50.363498 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-05ac1ee3-b37a-4270-a823-2be786b1b854 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: bafeccc8-8054-4e8c-8b20-e439424892a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:50.371226 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-05ac1ee3-b37a-4270-a823-2be786b1b854 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:50.371226 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-05ac1ee3-b37a-4270-a823-2be786b1b854 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:50.371541 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-05ac1ee3-b37a-4270-a823-2be786b1b854 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:50.372041 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-05ac1ee3-b37a-4270-a823-2be786b1b854 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:50.372500 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-05ac1ee3-b37a-4270-a823-2be786b1b854 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:50.373000 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-05ac1ee3-b37a-4270-a823-2be786b1b854 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:50.508175 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-05ac1ee3-b37a-4270-a823-2be786b1b854 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:41:50.515867 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-05ac1ee3-b37a-4270-a823-2be786b1b854 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7" status: 200 len: 1507 microversion: 2.1 time: 0.157892 Aug 07 22:41:50.516479 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 232/485] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:41:50 2022] GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:41:50.537301 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-75a8bf86-e6f3-4a43-8572-559e6cba6d7f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed447a23-4632-45c1-b8d1-22d32c2f1742", "device": "/dev/sdb"}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:41:50.540411 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-75a8bf86-e6f3-4a43-8572-559e6cba6d7f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: bafeccc8-8054-4e8c-8b20-e439424892a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:50.546565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-75a8bf86-e6f3-4a43-8572-559e6cba6d7f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:50.546982 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-75a8bf86-e6f3-4a43-8572-559e6cba6d7f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:50.547417 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-75a8bf86-e6f3-4a43-8572-559e6cba6d7f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:50.548135 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-75a8bf86-e6f3-4a43-8572-559e6cba6d7f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:50.548585 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-75a8bf86-e6f3-4a43-8572-559e6cba6d7f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:50.549013 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-75a8bf86-e6f3-4a43-8572-559e6cba6d7f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:50.957788 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-e32e5e3e-8cad-43d8-a717-0c063491dbbc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:50.961859 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-e32e5e3e-8cad-43d8-a717-0c063491dbbc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:50.964865 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e32e5e3e-8cad-43d8-a717-0c063491dbbc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:50.965386 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e32e5e3e-8cad-43d8-a717-0c063491dbbc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:50.965813 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e32e5e3e-8cad-43d8-a717-0c063491dbbc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:50.966488 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e32e5e3e-8cad-43d8-a717-0c063491dbbc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:50.966933 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e32e5e3e-8cad-43d8-a717-0c063491dbbc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:50.967350 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e32e5e3e-8cad-43d8-a717-0c063491dbbc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:50.995718 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-e32e5e3e-8cad-43d8-a717-0c063491dbbc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments/1f5d1f79-abea-46f6-b0a5-66e8e214d870" status: 200 len: 194 microversion: 2.20 time: 0.041986 Aug 07 22:41:50.996317 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 233/486] 10.222.0.30 () {60 vars in 1454 bytes} [Sun Aug 7 22:41:50 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments/1f5d1f79-abea-46f6-b0a5-66e8e214d870 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 22:41:51.066466 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-cca0cc68-d277-42a1-b300-5be1c9084118 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:51.066966 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-cca0cc68-d277-42a1-b300-5be1c9084118 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:51.074086 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cca0cc68-d277-42a1-b300-5be1c9084118 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:51.074562 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cca0cc68-d277-42a1-b300-5be1c9084118 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:51.075002 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cca0cc68-d277-42a1-b300-5be1c9084118 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:51.075687 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cca0cc68-d277-42a1-b300-5be1c9084118 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:51.076176 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cca0cc68-d277-42a1-b300-5be1c9084118 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:51.076605 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cca0cc68-d277-42a1-b300-5be1c9084118 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:51.157055 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.objects.instance [None req-cca0cc68-d277-42a1-b300-5be1c9084118 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lazy-loading 'services' on Instance uuid 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba {{(pid=129965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:41:51.241444 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-75a8bf86-e6f3-4a43-8572-559e6cba6d7f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "POST /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.707862 Aug 07 22:41:51.242197 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 254/487] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 22:41:50 2022] POST /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7/os-volume_attachments => generated 194 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:41:51.430328 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-cca0cc68-d277-42a1-b300-5be1c9084118 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments/1f5d1f79-abea-46f6-b0a5-66e8e214d870" status: 202 len: 0 microversion: 2.20 time: 0.367653 Aug 07 22:41:51.430986 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 234/488] 10.222.0.30 () {60 vars in 1457 bytes} [Sun Aug 7 22:41:51 2022] DELETE /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments/1f5d1f79-abea-46f6-b0a5-66e8e214d870 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 07 22:41:51.441053 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-7a9e4d61-8962-48d6-8409-e43cdae5603c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:51.443858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-7a9e4d61-8962-48d6-8409-e43cdae5603c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:51.450952 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7a9e4d61-8962-48d6-8409-e43cdae5603c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:51.452497 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7a9e4d61-8962-48d6-8409-e43cdae5603c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:51.452497 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7a9e4d61-8962-48d6-8409-e43cdae5603c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:51.452731 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7a9e4d61-8962-48d6-8409-e43cdae5603c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:51.453007 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7a9e4d61-8962-48d6-8409-e43cdae5603c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:51.453450 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7a9e4d61-8962-48d6-8409-e43cdae5603c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:51.484852 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-7a9e4d61-8962-48d6-8409-e43cdae5603c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049097 Aug 07 22:41:51.485395 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 255/489] 10.222.0.30 () {60 vars in 1343 bytes} [Sun Aug 7 22:41:51 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:41:51.490873 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-2573923c-5bfd-4e65-a802-3189beac5e12 req-ff1ffbc4-6c82-4ec2-8f97-a168a9a0b43b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62959a95-0c79-4d83-a375-147271e53ffa", "tag": "ffa75a68-45f7-47ee-941b-97d714ef438e"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:41:51.500501 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-2573923c-5bfd-4e65-a802-3189beac5e12 req-ff1ffbc4-6c82-4ec2-8f97-a168a9a0b43b service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:51.502513 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-2573923c-5bfd-4e65-a802-3189beac5e12 req-ff1ffbc4-6c82-4ec2-8f97-a168a9a0b43b service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:51.502513 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-2573923c-5bfd-4e65-a802-3189beac5e12 req-ff1ffbc4-6c82-4ec2-8f97-a168a9a0b43b service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:51.503982 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:51.514089 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-2573923c-5bfd-4e65-a802-3189beac5e12 req-ff1ffbc4-6c82-4ec2-8f97-a168a9a0b43b service nova] Creating event network-changed:ffa75a68-45f7-47ee-941b-97d714ef438e for instance 62959a95-0c79-4d83-a375-147271e53ffa on hv-cinder-85032 Aug 07 22:41:51.518951 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-2573923c-5bfd-4e65-a802-3189beac5e12 req-ff1ffbc4-6c82-4ec2-8f97-a168a9a0b43b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032320 Aug 07 22:41:51.519521 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 235/490] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:41:52.497393 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a67c8f95-384f-4e41-8978-75366b4c20de tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:52.499537 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a67c8f95-384f-4e41-8978-75366b4c20de tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:52.506380 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a67c8f95-384f-4e41-8978-75366b4c20de tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:52.506853 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a67c8f95-384f-4e41-8978-75366b4c20de tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:52.507294 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a67c8f95-384f-4e41-8978-75366b4c20de tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:52.507978 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a67c8f95-384f-4e41-8978-75366b4c20de tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:52.508449 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a67c8f95-384f-4e41-8978-75366b4c20de tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:52.508868 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a67c8f95-384f-4e41-8978-75366b4c20de tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:52.537996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a67c8f95-384f-4e41-8978-75366b4c20de tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044576 Aug 07 22:41:52.538554 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 256/491] 10.222.0.30 () {60 vars in 1343 bytes} [Sun Aug 7 22:41:52 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:41:53.551413 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-8875cf44-fb9a-43f6-95bd-03dde976f5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:53.553714 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-8875cf44-fb9a-43f6-95bd-03dde976f5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:53.560477 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8875cf44-fb9a-43f6-95bd-03dde976f5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:53.560947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8875cf44-fb9a-43f6-95bd-03dde976f5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:53.561374 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8875cf44-fb9a-43f6-95bd-03dde976f5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:53.562049 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8875cf44-fb9a-43f6-95bd-03dde976f5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:53.562494 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8875cf44-fb9a-43f6-95bd-03dde976f5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:53.562910 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8875cf44-fb9a-43f6-95bd-03dde976f5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:53.591902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-8875cf44-fb9a-43f6-95bd-03dde976f5cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045303 Aug 07 22:41:53.592474 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 236/492] 10.222.0.30 () {60 vars in 1343 bytes} [Sun Aug 7 22:41:53 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:41:54.604990 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-9be4f002-0bbc-4db1-aaec-0b62b750bb20 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:54.607165 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-9be4f002-0bbc-4db1-aaec-0b62b750bb20 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:54.613534 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9be4f002-0bbc-4db1-aaec-0b62b750bb20 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:54.614018 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9be4f002-0bbc-4db1-aaec-0b62b750bb20 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:54.614452 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9be4f002-0bbc-4db1-aaec-0b62b750bb20 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:54.615852 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9be4f002-0bbc-4db1-aaec-0b62b750bb20 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:54.616372 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9be4f002-0bbc-4db1-aaec-0b62b750bb20 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:54.616759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9be4f002-0bbc-4db1-aaec-0b62b750bb20 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:54.645648 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-9be4f002-0bbc-4db1-aaec-0b62b750bb20 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044672 Aug 07 22:41:54.646324 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 257/493] 10.222.0.30 () {60 vars in 1343 bytes} [Sun Aug 7 22:41:54 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:41:55.657192 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-1190c6d6-8510-4d32-9f47-1c3c001e3671 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:55.659307 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-1190c6d6-8510-4d32-9f47-1c3c001e3671 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:55.666238 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1190c6d6-8510-4d32-9f47-1c3c001e3671 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:55.666715 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1190c6d6-8510-4d32-9f47-1c3c001e3671 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:55.667147 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1190c6d6-8510-4d32-9f47-1c3c001e3671 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:55.667832 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1190c6d6-8510-4d32-9f47-1c3c001e3671 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:55.668307 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1190c6d6-8510-4d32-9f47-1c3c001e3671 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:55.668732 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1190c6d6-8510-4d32-9f47-1c3c001e3671 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:55.697959 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-1190c6d6-8510-4d32-9f47-1c3c001e3671 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044700 Aug 07 22:41:55.698508 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 237/494] 10.222.0.30 () {60 vars in 1343 bytes} [Sun Aug 7 22:41:55 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:41:56.710091 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f5c83040-7a6e-4c2c-ae67-8f2e47dcc5ef tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:56.712279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f5c83040-7a6e-4c2c-ae67-8f2e47dcc5ef tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:56.718927 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f5c83040-7a6e-4c2c-ae67-8f2e47dcc5ef tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:56.719389 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f5c83040-7a6e-4c2c-ae67-8f2e47dcc5ef tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:56.719823 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f5c83040-7a6e-4c2c-ae67-8f2e47dcc5ef tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:56.720545 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f5c83040-7a6e-4c2c-ae67-8f2e47dcc5ef tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:56.720991 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f5c83040-7a6e-4c2c-ae67-8f2e47dcc5ef tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:56.721410 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f5c83040-7a6e-4c2c-ae67-8f2e47dcc5ef tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:56.750875 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f5c83040-7a6e-4c2c-ae67-8f2e47dcc5ef tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044645 Aug 07 22:41:56.751347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 258/495] 10.222.0.30 () {60 vars in 1343 bytes} [Sun Aug 7 22:41:56 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:41:57.763646 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-167c9ce6-ab4e-4680-8c54-ae504c3d7354 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:57.765952 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-167c9ce6-ab4e-4680-8c54-ae504c3d7354 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:57.772718 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-167c9ce6-ab4e-4680-8c54-ae504c3d7354 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:57.773187 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-167c9ce6-ab4e-4680-8c54-ae504c3d7354 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:57.773617 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-167c9ce6-ab4e-4680-8c54-ae504c3d7354 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:57.774308 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-167c9ce6-ab4e-4680-8c54-ae504c3d7354 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:57.774753 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-167c9ce6-ab4e-4680-8c54-ae504c3d7354 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:57.775166 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-167c9ce6-ab4e-4680-8c54-ae504c3d7354 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:57.806672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-167c9ce6-ab4e-4680-8c54-ae504c3d7354 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047369 Aug 07 22:41:57.807225 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 238/496] 10.222.0.30 () {60 vars in 1343 bytes} [Sun Aug 7 22:41:57 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:41:58.819248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-8a652622-d21d-4e7b-815b-4ff454d66eb5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:58.821433 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-8a652622-d21d-4e7b-815b-4ff454d66eb5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:58.827891 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8a652622-d21d-4e7b-815b-4ff454d66eb5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:58.829889 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8a652622-d21d-4e7b-815b-4ff454d66eb5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:58.829889 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8a652622-d21d-4e7b-815b-4ff454d66eb5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:58.829889 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8a652622-d21d-4e7b-815b-4ff454d66eb5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:58.830167 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8a652622-d21d-4e7b-815b-4ff454d66eb5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:58.830330 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8a652622-d21d-4e7b-815b-4ff454d66eb5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:58.844428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:41:58.860933 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-8a652622-d21d-4e7b-815b-4ff454d66eb5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045858 Aug 07 22:41:58.861509 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 259/497] 10.222.0.30 () {60 vars in 1343 bytes} [Sun Aug 7 22:41:58 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:41:59.873750 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-8d4b2a13-244b-4805-9d14-0b42f24e6c9a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:41:59.875798 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-8d4b2a13-244b-4805-9d14-0b42f24e6c9a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:41:59.882660 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8d4b2a13-244b-4805-9d14-0b42f24e6c9a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:59.883139 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8d4b2a13-244b-4805-9d14-0b42f24e6c9a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:59.883570 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8d4b2a13-244b-4805-9d14-0b42f24e6c9a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:59.884270 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8d4b2a13-244b-4805-9d14-0b42f24e6c9a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:41:59.884718 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8d4b2a13-244b-4805-9d14-0b42f24e6c9a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:41:59.885391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8d4b2a13-244b-4805-9d14-0b42f24e6c9a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:41:59.913732 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-8d4b2a13-244b-4805-9d14-0b42f24e6c9a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044094 Aug 07 22:41:59.914511 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 239/498] 10.222.0.30 () {60 vars in 1343 bytes} [Sun Aug 7 22:41:59 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:42:00.925527 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a303a921-b4e2-4bfb-9adb-df1251204720 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:00.928331 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a303a921-b4e2-4bfb-9adb-df1251204720 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:00.935053 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a303a921-b4e2-4bfb-9adb-df1251204720 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:00.935536 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a303a921-b4e2-4bfb-9adb-df1251204720 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:00.935973 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a303a921-b4e2-4bfb-9adb-df1251204720 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:00.936684 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a303a921-b4e2-4bfb-9adb-df1251204720 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:00.937135 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a303a921-b4e2-4bfb-9adb-df1251204720 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:00.937555 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a303a921-b4e2-4bfb-9adb-df1251204720 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:00.966996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a303a921-b4e2-4bfb-9adb-df1251204720 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045801 Aug 07 22:42:00.967541 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 260/499] 10.222.0.30 () {60 vars in 1343 bytes} [Sun Aug 7 22:42:00 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:42:01.978926 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-3fe0b0d0-0d35-4f54-ae2b-f39c268f9c1d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:01.981057 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-3fe0b0d0-0d35-4f54-ae2b-f39c268f9c1d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:01.987807 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3fe0b0d0-0d35-4f54-ae2b-f39c268f9c1d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:01.988659 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3fe0b0d0-0d35-4f54-ae2b-f39c268f9c1d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:01.988963 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3fe0b0d0-0d35-4f54-ae2b-f39c268f9c1d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:01.989676 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3fe0b0d0-0d35-4f54-ae2b-f39c268f9c1d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:01.990117 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3fe0b0d0-0d35-4f54-ae2b-f39c268f9c1d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:01.990531 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3fe0b0d0-0d35-4f54-ae2b-f39c268f9c1d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:02.020270 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-3fe0b0d0-0d35-4f54-ae2b-f39c268f9c1d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045263 Aug 07 22:42:02.021441 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 240/500] 10.222.0.30 () {60 vars in 1343 bytes} [Sun Aug 7 22:42:01 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:42:03.033118 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-3e67dc60-64a9-4926-838e-d4d7fd4f717b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:03.035300 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-3e67dc60-64a9-4926-838e-d4d7fd4f717b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:03.042642 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3e67dc60-64a9-4926-838e-d4d7fd4f717b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:03.043127 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3e67dc60-64a9-4926-838e-d4d7fd4f717b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:03.043566 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3e67dc60-64a9-4926-838e-d4d7fd4f717b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:03.044311 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3e67dc60-64a9-4926-838e-d4d7fd4f717b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:03.044767 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3e67dc60-64a9-4926-838e-d4d7fd4f717b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:03.045189 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3e67dc60-64a9-4926-838e-d4d7fd4f717b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:03.074476 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-3e67dc60-64a9-4926-838e-d4d7fd4f717b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045680 Aug 07 22:42:03.075043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 261/501] 10.222.0.30 () {60 vars in 1343 bytes} [Sun Aug 7 22:42:03 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:42:03.139494 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d3e5c569-0db7-4d48-83a8-b9bcf509ef71 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:03.140727 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-d3e5c569-0db7-4d48-83a8-b9bcf509ef71 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:03.147743 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d3e5c569-0db7-4d48-83a8-b9bcf509ef71 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:03.148258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d3e5c569-0db7-4d48-83a8-b9bcf509ef71 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:03.148697 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d3e5c569-0db7-4d48-83a8-b9bcf509ef71 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:03.149436 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d3e5c569-0db7-4d48-83a8-b9bcf509ef71 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:03.149836 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d3e5c569-0db7-4d48-83a8-b9bcf509ef71 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:03.150257 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d3e5c569-0db7-4d48-83a8-b9bcf509ef71 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:03.175569 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-d3e5c569-0db7-4d48-83a8-b9bcf509ef71 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Going to try to terminate instance {{(pid=129965) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 22:42:03.481644 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-d3e5c569-0db7-4d48-83a8-b9bcf509ef71 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 204 len: 0 microversion: 2.20 time: 0.345719 Aug 07 22:42:03.482159 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 241/502] 10.222.0.30 () {60 vars in 1280 bytes} [Sun Aug 7 22:42:03 2022] DELETE /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 07 22:42:03.491597 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-694f6ce4-eaf6-48a9-aae3-e40a6632dd96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:03.492231 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-694f6ce4-eaf6-48a9-aae3-e40a6632dd96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:03.498471 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-694f6ce4-eaf6-48a9-aae3-e40a6632dd96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:03.499191 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-694f6ce4-eaf6-48a9-aae3-e40a6632dd96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:03.499622 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-694f6ce4-eaf6-48a9-aae3-e40a6632dd96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:03.500376 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-694f6ce4-eaf6-48a9-aae3-e40a6632dd96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:03.500824 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-694f6ce4-eaf6-48a9-aae3-e40a6632dd96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:03.501247 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-694f6ce4-eaf6-48a9-aae3-e40a6632dd96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:03.639211 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-694f6ce4-eaf6-48a9-aae3-e40a6632dd96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:03.647427 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-694f6ce4-eaf6-48a9-aae3-e40a6632dd96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:03.648950 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-694f6ce4-eaf6-48a9-aae3-e40a6632dd96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:03.650091 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-694f6ce4-eaf6-48a9-aae3-e40a6632dd96 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1723 microversion: 2.20 time: 0.163570 Aug 07 22:42:03.650839 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 262/503] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:42:03 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:42:04.674202 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-4dc13355-f8e4-46cd-bd10-4f2370bbae2c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:04.674893 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-4dc13355-f8e4-46cd-bd10-4f2370bbae2c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:04.681865 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4dc13355-f8e4-46cd-bd10-4f2370bbae2c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:04.682344 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4dc13355-f8e4-46cd-bd10-4f2370bbae2c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:04.682773 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4dc13355-f8e4-46cd-bd10-4f2370bbae2c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:04.683449 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4dc13355-f8e4-46cd-bd10-4f2370bbae2c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:04.683895 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4dc13355-f8e4-46cd-bd10-4f2370bbae2c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:04.684347 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4dc13355-f8e4-46cd-bd10-4f2370bbae2c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:04.812932 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-4dc13355-f8e4-46cd-bd10-4f2370bbae2c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:04.821006 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-4dc13355-f8e4-46cd-bd10-4f2370bbae2c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:04.822505 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-4dc13355-f8e4-46cd-bd10-4f2370bbae2c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:04.823663 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-4dc13355-f8e4-46cd-bd10-4f2370bbae2c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1723 microversion: 2.20 time: 0.153753 Aug 07 22:42:04.824253 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 242/504] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:42:04 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:42:05.847947 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-1bff53e2-20f5-4428-b514-0dea81a36e71 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:05.848575 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-1bff53e2-20f5-4428-b514-0dea81a36e71 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:05.856560 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1bff53e2-20f5-4428-b514-0dea81a36e71 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:05.857033 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1bff53e2-20f5-4428-b514-0dea81a36e71 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:05.857460 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1bff53e2-20f5-4428-b514-0dea81a36e71 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:05.858135 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1bff53e2-20f5-4428-b514-0dea81a36e71 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:05.858577 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1bff53e2-20f5-4428-b514-0dea81a36e71 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:05.859000 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1bff53e2-20f5-4428-b514-0dea81a36e71 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:05.992583 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-1bff53e2-20f5-4428-b514-0dea81a36e71 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:06.001021 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-1bff53e2-20f5-4428-b514-0dea81a36e71 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:06.002528 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-1bff53e2-20f5-4428-b514-0dea81a36e71 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:06.003677 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-1bff53e2-20f5-4428-b514-0dea81a36e71 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1723 microversion: 2.20 time: 0.159595 Aug 07 22:42:06.004281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 263/505] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:42:05 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:42:07.025961 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7a976e95-7369-417a-b1c3-78ff8a08c94e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:07.026565 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-7a976e95-7369-417a-b1c3-78ff8a08c94e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:07.033167 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7a976e95-7369-417a-b1c3-78ff8a08c94e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:07.033651 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7a976e95-7369-417a-b1c3-78ff8a08c94e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:07.034088 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7a976e95-7369-417a-b1c3-78ff8a08c94e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:07.034804 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7a976e95-7369-417a-b1c3-78ff8a08c94e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:07.035256 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7a976e95-7369-417a-b1c3-78ff8a08c94e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:07.035678 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7a976e95-7369-417a-b1c3-78ff8a08c94e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:07.166767 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7a976e95-7369-417a-b1c3-78ff8a08c94e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:07.174881 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7a976e95-7369-417a-b1c3-78ff8a08c94e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:07.176505 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7a976e95-7369-417a-b1c3-78ff8a08c94e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:07.178387 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-7a976e95-7369-417a-b1c3-78ff8a08c94e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1723 microversion: 2.20 time: 0.155726 Aug 07 22:42:07.179126 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 243/506] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:42:07 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:42:08.201209 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f8dd62ba-e571-4007-b09b-c35a9e097125 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:08.202532 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f8dd62ba-e571-4007-b09b-c35a9e097125 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:08.205170 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_api:SELECT=56 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:08.210889 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f8dd62ba-e571-4007-b09b-c35a9e097125 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:08.211444 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f8dd62ba-e571-4007-b09b-c35a9e097125 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:08.212450 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f8dd62ba-e571-4007-b09b-c35a9e097125 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:08.213225 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f8dd62ba-e571-4007-b09b-c35a9e097125 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:08.213745 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f8dd62ba-e571-4007-b09b-c35a9e097125 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:08.214629 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f8dd62ba-e571-4007-b09b-c35a9e097125 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:08.303523 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-485bd728-4c02-4be9-bc6f-793d2a39c9de req-1fdd890c-5c40-4c90-bc9c-5afd6fe01b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bda9470-bb0f-45e2-9f1b-e4d1db51aeba", "name": "network-vif-deleted", "tag": "1f737453-339e-4e1d-8c0b-b401edea34b1"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:42:08.309058 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f8dd62ba-e571-4007-b09b-c35a9e097125 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:08.314725 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-485bd728-4c02-4be9-bc6f-793d2a39c9de req-1fdd890c-5c40-4c90-bc9c-5afd6fe01b99 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:08.315503 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-485bd728-4c02-4be9-bc6f-793d2a39c9de req-1fdd890c-5c40-4c90-bc9c-5afd6fe01b99 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:08.316280 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-485bd728-4c02-4be9-bc6f-793d2a39c9de req-1fdd890c-5c40-4c90-bc9c-5afd6fe01b99 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:08.318193 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f8dd62ba-e571-4007-b09b-c35a9e097125 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:08.320297 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f8dd62ba-e571-4007-b09b-c35a9e097125 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:08.321450 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f8dd62ba-e571-4007-b09b-c35a9e097125 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 200 len: 1656 microversion: 2.20 time: 0.124138 Aug 07 22:42:08.330228 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-485bd728-4c02-4be9-bc6f-793d2a39c9de req-1fdd890c-5c40-4c90-bc9c-5afd6fe01b99 service nova] Creating event network-vif-deleted:1f737453-339e-4e1d-8c0b-b401edea34b1 for instance 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba on hv-cinder-85032 Aug 07 22:42:08.336476 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-485bd728-4c02-4be9-bc6f-793d2a39c9de req-1fdd890c-5c40-4c90-bc9c-5afd6fe01b99 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036980 Aug 07 22:42:08.337309 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 244/507] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:42:08.337591 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 264/508] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:42:08 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 1656 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:42:09.350275 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-eb9ae31e-8647-4a6c-9f82-2252f54b5bbc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:09.350968 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-eb9ae31e-8647-4a6c-9f82-2252f54b5bbc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:09.362369 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-eb9ae31e-8647-4a6c-9f82-2252f54b5bbc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:09.362881 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-eb9ae31e-8647-4a6c-9f82-2252f54b5bbc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:09.363311 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-eb9ae31e-8647-4a6c-9f82-2252f54b5bbc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:09.364002 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-eb9ae31e-8647-4a6c-9f82-2252f54b5bbc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:09.364479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-eb9ae31e-8647-4a6c-9f82-2252f54b5bbc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:09.364992 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-eb9ae31e-8647-4a6c-9f82-2252f54b5bbc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:09.379667 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-eb9ae31e-8647-4a6c-9f82-2252f54b5bbc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] HTTP exception thrown: Instance 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba could not be found. Aug 07 22:42:09.381925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-eb9ae31e-8647-4a6c-9f82-2252f54b5bbc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Request method failure captured: Aug 07 22:42:09.381925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba HTTP/1.1 Aug 07 22:42:09.381925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:42:09.381925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:42:09.381925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:42:09.381925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:42:09.381925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:42:09.381925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:42:09.381925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:42:09.381925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:42:09.381925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8D6thRYUMBWh5dPVk1nH64PMoAYZVfdTWstvuCrsmwiLbLyTV7XfxMosWmVDoj_8KTpyS29dJclN0n4ZR2KnewZn1iK-1wcZpnjsUMSXJ2ZJNCKAG2-kEkLWefx5_Nzu7eMjXR8ksTBDjIS5UWmOAGNA7WBPIZMEFdpQwGVcFMv6OX0 Aug 07 22:42:09.381925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:42:09.381925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:42:09.381925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:42:09.381925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:42:09.381925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 22:42:09.381925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:42:09.381925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:42:09.381925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 3f7ea2694e7641088d957060a1001d86 Aug 07 22:42:09.381925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-503792829 Aug 07 22:42:09.381925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:42:09.381925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:42:09.383496 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f7ea2694e7641088d957060a1001d86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f7ea2694e7641088d957060a1001d86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f7ea2694e7641088d957060a1001d86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f7ea2694e7641088d957060a1001d86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:42:09.383496 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-AttachVolumeShelveTestJSON-503792829 Aug 07 22:42:09.383496 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 3f7ea2694e7641088d957060a1001d86 Aug 07 22:42:09.383496 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-503792829 Aug 07 22:42:09.383496 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-AttachVolumeShelveTestJSON-503792829-project Aug 07 22:42:09.383496 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:42:09.383496 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:42:09.383496 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: 05ef5ec6afb84c4abc0cb4862f041dd1 Aug 07 22:42:09.383496 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-AttachVolumeShelveTestJSON-503792829-project Aug 07 22:42:09.383496 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: > Aug 07 22:42:09.383496 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Instance 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba could not be found. Aug 07 22:42:09.383496 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': '8bda9470-bb0f-45e2-9f1b-e4d1db51aeba'} Aug 07 22:42:09.392307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:42:09.392307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:42:09.392307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:42:09.392307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:42:09.392307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:42:09.392307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:42:09.392307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:42:09.392307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:42:09.392307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:42:09.392307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:42:09.392307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba could not be found. Aug 07 22:42:09.392307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:42:09.392307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:42:09.392307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:42:09.392307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:42:09.392307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:42:09.392307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:42:09.392307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:42:09.392307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:42:09.392307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:42:09.395046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:42:09.395046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:42:09.395046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:42:09.395046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:42:09.395046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:42:09.395046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:42:09.395046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:42:09.395046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba could not be found. Aug 07 22:42:09.395046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:42:09.395046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:42:09.395046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:42:09.395046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:42:09.395046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:42:09.395046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:42:09.395046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:42:09.395046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:42:09.395046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba could not be found. Aug 07 22:42:09.395046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:42:09.397855 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-eb9ae31e-8647-4a6c-9f82-2252f54b5bbc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Returning 404 to user: Instance 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:42:09.397855 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-eb9ae31e-8647-4a6c-9f82-2252f54b5bbc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 404 len: 111 microversion: 2.20 time: 0.037911 Aug 07 22:42:09.397855 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 265/509] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:42:09 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 22:42:09.398144 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-a573c000-64d8-4eff-aa24-898d18392a41 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '.version_select at 0x7fc0ac65ef70>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:09.512114 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-a573c000-64d8-4eff-aa24-898d18392a41 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2009987897" status: 204 len: 0 microversion: 2.20 time: 0.122568 Aug 07 22:42:09.512713 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 245/510] 10.222.0.30 () {60 vars in 1262 bytes} [Sun Aug 7 22:42:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2009987897 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 07 22:42:10.301065 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-c747ca71-9f74-4c63-80b4-e33f2ed93d7e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Action: 'create', calling method: .version_select at 0x7fc09fc9fee0>, body: {"keypair": {"name": "tempest-keypair-1974831983", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8q8jqQQm1UP0Y43xfZEKNAFabousXH/EW+ExfDy7FSBjmRbGWNQ2utifGOz4oC8hBDQIk1EnbdEjWTm45lCoEZKVjf7/ruxhAY/HzTcx4xTdsdjjZGMsP2/4Df7bcQug=="}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:42:10.317861 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-c747ca71-9f74-4c63-80b4-e33f2ed93d7e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Getting quotas for project 3f7ea2694e7641088d957060a1001d86. Resources: {'key_pairs'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:42:10.322235 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-c747ca71-9f74-4c63-80b4-e33f2ed93d7e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Getting quotas for user 05ef5ec6afb84c4abc0cb4862f041dd1 and project 3f7ea2694e7641088d957060a1001d86. Resources: {'key_pairs'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:42:10.408902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-c747ca71-9f74-4c63-80b4-e33f2ed93d7e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.111640 Aug 07 22:42:10.409542 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 266/511] 10.222.0.30 () {62 vars in 1200 bytes} [Sun Aug 7 22:42:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 113 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 07 22:42:11.206053 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-364f2b77-48fc-4051-a602-66a30546556d tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:11.206674 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-364f2b77-48fc-4051-a602-66a30546556d tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: bafeccc8-8054-4e8c-8b20-e439424892a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:11.215011 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-364f2b77-48fc-4051-a602-66a30546556d tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:11.215505 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-364f2b77-48fc-4051-a602-66a30546556d tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:11.215943 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-364f2b77-48fc-4051-a602-66a30546556d tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:11.216697 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-364f2b77-48fc-4051-a602-66a30546556d tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:11.217153 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-364f2b77-48fc-4051-a602-66a30546556d tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:11.217581 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-364f2b77-48fc-4051-a602-66a30546556d tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:11.297084 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.objects.instance [None req-364f2b77-48fc-4051-a602-66a30546556d tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lazy-loading 'services' on Instance uuid bafeccc8-8054-4e8c-8b20-e439424892a7 {{(pid=129965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:42:11.520903 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-364f2b77-48fc-4051-a602-66a30546556d tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7/os-volume_attachments/ed447a23-4632-45c1-b8d1-22d32c2f1742" status: 202 len: 0 microversion: 2.1 time: 0.319128 Aug 07 22:42:11.522456 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 246/512] 10.222.0.30 () {58 vars in 1416 bytes} [Sun Aug 7 22:42:11 2022] DELETE /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7/os-volume_attachments/ed447a23-4632-45c1-b8d1-22d32c2f1742 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:42:12.878110 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-ee3ee510-18a2-4c15-bc4c-1d91f506f643 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1426967770", "imageRef": "91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "057d9455-09f9-43b3-b9b9-43213b4e9159"}], "security_groups": [{"name": "tempest-securitygroup--1394867984"}], "key_name": "tempest-keypair-1974831983", "user_data": "}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:42:12.984171 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.network.neutron [None req-ee3ee510-18a2-4c15-bc4c-1d91f506f643 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] validate_networks() for [('057d9455-09f9-43b3-b9b9-43213b4e9159', None, None, None, None, None)] {{(pid=129964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 22:42:13.350796 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-ee3ee510-18a2-4c15-bc4c-1d91f506f643 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Flavor limits 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 22:42:13.351211 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-ee3ee510-18a2-4c15-bc4c-1d91f506f643 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Image limits 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 22:42:13.351705 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-ee3ee510-18a2-4c15-bc4c-1d91f506f643 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Flavor pref 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 22:42:13.352135 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-ee3ee510-18a2-4c15-bc4c-1d91f506f643 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Image pref 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 22:42:13.352541 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-ee3ee510-18a2-4c15-bc4c-1d91f506f643 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 22:42:13.361155 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ee3ee510-18a2-4c15-bc4c-1d91f506f643 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:13.361630 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ee3ee510-18a2-4c15-bc4c-1d91f506f643 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:13.362052 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ee3ee510-18a2-4c15-bc4c-1d91f506f643 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:13.362764 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ee3ee510-18a2-4c15-bc4c-1d91f506f643 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:13.363208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ee3ee510-18a2-4c15-bc4c-1d91f506f643 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:13.363628 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ee3ee510-18a2-4c15-bc4c-1d91f506f643 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:13.379735 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-ee3ee510-18a2-4c15-bc4c-1d91f506f643 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Getting quotas for project 3f7ea2694e7641088d957060a1001d86. Resources: {'cores', 'instances', 'ram'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:42:13.384413 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-ee3ee510-18a2-4c15-bc4c-1d91f506f643 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Getting quotas for user 05ef5ec6afb84c4abc0cb4862f041dd1 and project 3f7ea2694e7641088d957060a1001d86. Resources: {'cores', 'instances', 'ram'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:42:13.395423 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-ee3ee510-18a2-4c15-bc4c-1d91f506f643 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Going to run 1 instances... {{(pid=129964) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 22:42:13.398452 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-ee3ee510-18a2-4c15-bc4c-1d91f506f643 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 22:42:13.518398 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-ee3ee510-18a2-4c15-bc4c-1d91f506f643 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.645003 Aug 07 22:42:13.519996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 267/513] 10.222.0.30 () {62 vars in 1188 bytes} [Sun Aug 7 22:42:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 07 22:42:13.531745 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-5af0c80d-0fc5-47e5-b5e5-f706ddd97cff tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:13.532467 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-5af0c80d-0fc5-47e5-b5e5-f706ddd97cff tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:13.588844 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-5af0c80d-0fc5-47e5-b5e5-f706ddd97cff tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:13.596080 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-5af0c80d-0fc5-47e5-b5e5-f706ddd97cff tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:13.597575 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-5af0c80d-0fc5-47e5-b5e5-f706ddd97cff tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:13.598653 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-5af0c80d-0fc5-47e5-b5e5-f706ddd97cff tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1282 microversion: 2.20 time: 0.071714 Aug 07 22:42:13.599235 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 247/514] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:42:13 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1282 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:42:13.699174 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-23dfe8e9-a6c8-4cff-baa8-d84807086677 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:13.699668 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-23dfe8e9-a6c8-4cff-baa8-d84807086677 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: bafeccc8-8054-4e8c-8b20-e439424892a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:13.706254 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-23dfe8e9-a6c8-4cff-baa8-d84807086677 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:13.708671 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-23dfe8e9-a6c8-4cff-baa8-d84807086677 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:13.708671 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-23dfe8e9-a6c8-4cff-baa8-d84807086677 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:13.708671 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-23dfe8e9-a6c8-4cff-baa8-d84807086677 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:13.708671 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-23dfe8e9-a6c8-4cff-baa8-d84807086677 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:13.709627 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-23dfe8e9-a6c8-4cff-baa8-d84807086677 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:13.733615 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-23dfe8e9-a6c8-4cff-baa8-d84807086677 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: bafeccc8-8054-4e8c-8b20-e439424892a7] Going to try to terminate instance {{(pid=129964) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 22:42:14.001921 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-23dfe8e9-a6c8-4cff-baa8-d84807086677 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7" status: 204 len: 0 microversion: 2.1 time: 0.306236 Aug 07 22:42:14.002529 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 268/515] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:42:13 2022] DELETE /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 22:42:14.012160 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-828b2109-b7c1-497a-ba15-f4c83d30051c tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:14.012772 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-828b2109-b7c1-497a-ba15-f4c83d30051c tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: bafeccc8-8054-4e8c-8b20-e439424892a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:14.019867 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-828b2109-b7c1-497a-ba15-f4c83d30051c tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:14.020458 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-828b2109-b7c1-497a-ba15-f4c83d30051c tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:14.020890 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-828b2109-b7c1-497a-ba15-f4c83d30051c tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:14.022357 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-828b2109-b7c1-497a-ba15-f4c83d30051c tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:14.022880 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-828b2109-b7c1-497a-ba15-f4c83d30051c tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:14.023287 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-828b2109-b7c1-497a-ba15-f4c83d30051c tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:14.154214 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-828b2109-b7c1-497a-ba15-f4c83d30051c tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:14.162603 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-828b2109-b7c1-497a-ba15-f4c83d30051c tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7" status: 200 len: 1513 microversion: 2.1 time: 0.154308 Aug 07 22:42:14.163351 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 248/516] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:42:14 2022] GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:42:14.621497 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-8c7e2e0d-b80b-46c3-8025-0256c422df4c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:14.622130 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-8c7e2e0d-b80b-46c3-8025-0256c422df4c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:14.628176 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8c7e2e0d-b80b-46c3-8025-0256c422df4c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:14.628664 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8c7e2e0d-b80b-46c3-8025-0256c422df4c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:14.629100 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8c7e2e0d-b80b-46c3-8025-0256c422df4c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:14.629787 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8c7e2e0d-b80b-46c3-8025-0256c422df4c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:14.630236 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8c7e2e0d-b80b-46c3-8025-0256c422df4c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:14.631191 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8c7e2e0d-b80b-46c3-8025-0256c422df4c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:14.695994 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-8c7e2e0d-b80b-46c3-8025-0256c422df4c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:14.703946 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-8c7e2e0d-b80b-46c3-8025-0256c422df4c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:14.705475 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-8c7e2e0d-b80b-46c3-8025-0256c422df4c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:14.706582 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-8c7e2e0d-b80b-46c3-8025-0256c422df4c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1286 microversion: 2.20 time: 0.089420 Aug 07 22:42:14.707135 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 269/517] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:42:14 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:42:15.184170 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d107755a-8004-4364-91a1-062cf19c81c0 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:15.184781 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-d107755a-8004-4364-91a1-062cf19c81c0 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: bafeccc8-8054-4e8c-8b20-e439424892a7] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:15.191156 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d107755a-8004-4364-91a1-062cf19c81c0 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:15.191677 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d107755a-8004-4364-91a1-062cf19c81c0 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:15.192084 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d107755a-8004-4364-91a1-062cf19c81c0 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:15.192767 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d107755a-8004-4364-91a1-062cf19c81c0 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:15.193834 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d107755a-8004-4364-91a1-062cf19c81c0 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:15.194250 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d107755a-8004-4364-91a1-062cf19c81c0 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:15.323011 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-d107755a-8004-4364-91a1-062cf19c81c0 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:15.330829 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-d107755a-8004-4364-91a1-062cf19c81c0 tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7" status: 200 len: 1513 microversion: 2.1 time: 0.150479 Aug 07 22:42:15.331393 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 249/518] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:42:15 2022] GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:42:15.729667 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-0142adc8-65b1-4f73-874f-19d24d6bb92b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:15.730324 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-0142adc8-65b1-4f73-874f-19d24d6bb92b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:15.736670 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0142adc8-65b1-4f73-874f-19d24d6bb92b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:15.737148 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0142adc8-65b1-4f73-874f-19d24d6bb92b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:15.737580 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0142adc8-65b1-4f73-874f-19d24d6bb92b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:15.738263 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0142adc8-65b1-4f73-874f-19d24d6bb92b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:15.738709 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0142adc8-65b1-4f73-874f-19d24d6bb92b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:15.739129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0142adc8-65b1-4f73-874f-19d24d6bb92b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:15.803204 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-0142adc8-65b1-4f73-874f-19d24d6bb92b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:15.811156 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-0142adc8-65b1-4f73-874f-19d24d6bb92b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:15.812700 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-0142adc8-65b1-4f73-874f-19d24d6bb92b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:15.813790 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-0142adc8-65b1-4f73-874f-19d24d6bb92b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1286 microversion: 2.20 time: 0.088054 Aug 07 22:42:15.814593 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 270/519] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:42:15 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:42:16.331351 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-34356aa2-3d39-4df5-96c3-4a6deedb257a req-3db651db-c8c0-41fe-b32f-4b0279d758df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bafeccc8-8054-4e8c-8b20-e439424892a7", "name": "network-vif-deleted", "tag": "176ad337-d4eb-4601-aa99-1635af97d649"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:42:16.341720 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-34356aa2-3d39-4df5-96c3-4a6deedb257a req-3db651db-c8c0-41fe-b32f-4b0279d758df service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:16.342196 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-34356aa2-3d39-4df5-96c3-4a6deedb257a req-3db651db-c8c0-41fe-b32f-4b0279d758df service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:16.342631 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-34356aa2-3d39-4df5-96c3-4a6deedb257a req-3db651db-c8c0-41fe-b32f-4b0279d758df service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:16.352122 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-9a87c422-7b1b-41eb-8a0e-f848f3c195eb tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:16.352735 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-9a87c422-7b1b-41eb-8a0e-f848f3c195eb tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: bafeccc8-8054-4e8c-8b20-e439424892a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:16.356257 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-34356aa2-3d39-4df5-96c3-4a6deedb257a req-3db651db-c8c0-41fe-b32f-4b0279d758df service nova] Creating event network-vif-deleted:176ad337-d4eb-4601-aa99-1635af97d649 for instance bafeccc8-8054-4e8c-8b20-e439424892a7 on hv-cinder-85032 Aug 07 22:42:16.361321 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9a87c422-7b1b-41eb-8a0e-f848f3c195eb tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:16.361321 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9a87c422-7b1b-41eb-8a0e-f848f3c195eb tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:16.361321 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9a87c422-7b1b-41eb-8a0e-f848f3c195eb tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:16.361321 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9a87c422-7b1b-41eb-8a0e-f848f3c195eb tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:16.361698 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9a87c422-7b1b-41eb-8a0e-f848f3c195eb tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:16.361698 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9a87c422-7b1b-41eb-8a0e-f848f3c195eb tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:16.361845 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-34356aa2-3d39-4df5-96c3-4a6deedb257a req-3db651db-c8c0-41fe-b32f-4b0279d758df service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033683 Aug 07 22:42:16.361934 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 250/520] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:42:16.425440 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-9a87c422-7b1b-41eb-8a0e-f848f3c195eb tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def1da13ff2a47ada8e5f453061e3f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eea609cee794549a2c23cdb24fbb572', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:16.433941 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-9a87c422-7b1b-41eb-8a0e-f848f3c195eb tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7" status: 200 len: 1471 microversion: 2.1 time: 0.086317 Aug 07 22:42:16.435318 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 271/521] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:42:16 2022] GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7 => generated 1471 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:42:16.838089 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ba5ecf88-b7c5-4221-b51f-9ead33176b5e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:16.838952 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-ba5ecf88-b7c5-4221-b51f-9ead33176b5e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:16.841079 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:16.846684 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ba5ecf88-b7c5-4221-b51f-9ead33176b5e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:16.847208 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ba5ecf88-b7c5-4221-b51f-9ead33176b5e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:16.847649 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ba5ecf88-b7c5-4221-b51f-9ead33176b5e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:16.848409 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ba5ecf88-b7c5-4221-b51f-9ead33176b5e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:16.848874 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ba5ecf88-b7c5-4221-b51f-9ead33176b5e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:16.849387 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ba5ecf88-b7c5-4221-b51f-9ead33176b5e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:16.912431 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-ba5ecf88-b7c5-4221-b51f-9ead33176b5e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:16.920404 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-ba5ecf88-b7c5-4221-b51f-9ead33176b5e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:16.921914 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-ba5ecf88-b7c5-4221-b51f-9ead33176b5e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:16.923010 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-ba5ecf88-b7c5-4221-b51f-9ead33176b5e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1352 microversion: 2.20 time: 0.090232 Aug 07 22:42:16.923571 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 251/522] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:42:16 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:42:17.455316 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b22a0eee-cd70-44fb-a249-9cea82e8ff3f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:17.456068 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-b22a0eee-cd70-44fb-a249-9cea82e8ff3f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] [instance: bafeccc8-8054-4e8c-8b20-e439424892a7] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:17.463007 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b22a0eee-cd70-44fb-a249-9cea82e8ff3f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:17.466361 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b22a0eee-cd70-44fb-a249-9cea82e8ff3f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:17.466361 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b22a0eee-cd70-44fb-a249-9cea82e8ff3f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:17.466361 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b22a0eee-cd70-44fb-a249-9cea82e8ff3f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:17.466361 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b22a0eee-cd70-44fb-a249-9cea82e8ff3f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:17.466754 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b22a0eee-cd70-44fb-a249-9cea82e8ff3f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:17.480888 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-b22a0eee-cd70-44fb-a249-9cea82e8ff3f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] HTTP exception thrown: Instance bafeccc8-8054-4e8c-8b20-e439424892a7 could not be found. Aug 07 22:42:17.482139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b22a0eee-cd70-44fb-a249-9cea82e8ff3f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Request method failure captured: Aug 07 22:42:17.482139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7 HTTP/1.1 Aug 07 22:42:17.482139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:42:17.482139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:42:17.482139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:42:17.482139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:42:17.482139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:42:17.482139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:42:17.482139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:42:17.482139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:42:17.482139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8D8qwhX0wEgCjggI2A9gjlcsoKEaGkxFTU7JyBlNHNlAv-aSV7wspm9dyBC4W8hnBLcA9P27Rn10NvLU4VkitNy0IPGTxN4-9-qdSrlvf9YMuqjQNjVY2b9Y43nalaNvMgcU9XnOZvSGAo4KwUj7FimQ9xEmPzEXPTra09d2ESpTFi0 Aug 07 22:42:17.482139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:42:17.482139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:42:17.482139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:42:17.482139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:42:17.482139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:42:17.482139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:42:17.482139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 5eea609cee794549a2c23cdb24fbb572 Aug 07 22:42:17.482139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-VolumesSnapshotTestJSON-211203851 Aug 07 22:42:17.482139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:42:17.482139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:42:17.483500 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5eea609cee794549a2c23cdb24fbb572"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5eea609cee794549a2c23cdb24fbb572"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5eea609cee794549a2c23cdb24fbb572"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5eea609cee794549a2c23cdb24fbb572"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:42:17.483500 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-VolumesSnapshotTestJSON-211203851 Aug 07 22:42:17.483500 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 5eea609cee794549a2c23cdb24fbb572 Aug 07 22:42:17.483500 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-211203851 Aug 07 22:42:17.483500 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-VolumesSnapshotTestJSON-211203851-project Aug 07 22:42:17.483500 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:42:17.483500 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:42:17.483500 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: def1da13ff2a47ada8e5f453061e3f7c Aug 07 22:42:17.483500 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-VolumesSnapshotTestJSON-211203851-project Aug 07 22:42:17.483500 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: > Aug 07 22:42:17.483500 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Instance bafeccc8-8054-4e8c-8b20-e439424892a7 could not be found. Aug 07 22:42:17.483500 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': 'bafeccc8-8054-4e8c-8b20-e439424892a7'} Aug 07 22:42:17.484305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:42:17.484305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:42:17.484305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:42:17.484305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:42:17.484305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:42:17.484305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:42:17.484305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:42:17.484305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:42:17.484305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:42:17.484305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:42:17.484305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bafeccc8-8054-4e8c-8b20-e439424892a7 could not be found. Aug 07 22:42:17.484305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:42:17.484305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:42:17.484305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:42:17.484305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:42:17.484305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:42:17.484305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:42:17.484305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:42:17.484305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:42:17.484305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:42:17.486251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:42:17.486251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:42:17.486251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:42:17.486251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:42:17.486251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:42:17.486251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:42:17.486251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:42:17.486251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bafeccc8-8054-4e8c-8b20-e439424892a7 could not be found. Aug 07 22:42:17.486251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:42:17.486251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:42:17.486251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:42:17.486251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:42:17.486251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:42:17.486251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:42:17.486251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:42:17.486251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:42:17.486251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bafeccc8-8054-4e8c-8b20-e439424892a7 could not be found. Aug 07 22:42:17.486251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:42:17.487344 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b22a0eee-cd70-44fb-a249-9cea82e8ff3f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] Returning 404 to user: Instance bafeccc8-8054-4e8c-8b20-e439424892a7 could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:42:17.487344 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-b22a0eee-cd70-44fb-a249-9cea82e8ff3f tempest-VolumesSnapshotTestJSON-211203851 tempest-VolumesSnapshotTestJSON-211203851-project] 10.222.0.30 "GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7" status: 404 len: 111 microversion: 2.1 time: 0.032197 Aug 07 22:42:17.488733 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 272/523] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:42:17 2022] GET /compute/v2.1/servers/bafeccc8-8054-4e8c-8b20-e439424892a7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:42:17.946881 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-43384d60-5b32-4395-836e-35530cd656a1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:17.947541 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-43384d60-5b32-4395-836e-35530cd656a1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:17.955520 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-43384d60-5b32-4395-836e-35530cd656a1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:17.956206 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-43384d60-5b32-4395-836e-35530cd656a1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:17.956788 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-43384d60-5b32-4395-836e-35530cd656a1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:17.957488 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-43384d60-5b32-4395-836e-35530cd656a1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:17.957937 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-43384d60-5b32-4395-836e-35530cd656a1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:17.958491 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-43384d60-5b32-4395-836e-35530cd656a1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:18.167066 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-43384d60-5b32-4395-836e-35530cd656a1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:18.175032 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-43384d60-5b32-4395-836e-35530cd656a1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:18.176634 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-43384d60-5b32-4395-836e-35530cd656a1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:18.178216 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-43384d60-5b32-4395-836e-35530cd656a1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1408 microversion: 2.20 time: 0.236120 Aug 07 22:42:18.178861 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 252/524] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:42:17 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:42:18.375205 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-597f7b0c-1aac-4307-b933-fcbe15ecae84 req-de02955f-f6ca-4e4e-b5b5-9d5c105e583c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cef2464-0337-4fbd-a727-a24160f14f99", "tag": "28f8e101-7a4a-4833-b344-83657618e970"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:42:18.385871 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-597f7b0c-1aac-4307-b933-fcbe15ecae84 req-de02955f-f6ca-4e4e-b5b5-9d5c105e583c service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:18.391066 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-597f7b0c-1aac-4307-b933-fcbe15ecae84 req-de02955f-f6ca-4e4e-b5b5-9d5c105e583c service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:18.391066 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-597f7b0c-1aac-4307-b933-fcbe15ecae84 req-de02955f-f6ca-4e4e-b5b5-9d5c105e583c service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:18.397668 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-597f7b0c-1aac-4307-b933-fcbe15ecae84 req-de02955f-f6ca-4e4e-b5b5-9d5c105e583c service nova] Creating event network-changed:28f8e101-7a4a-4833-b344-83657618e970 for instance 9cef2464-0337-4fbd-a727-a24160f14f99 on hv-cinder-85032 Aug 07 22:42:18.402577 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-597f7b0c-1aac-4307-b933-fcbe15ecae84 req-de02955f-f6ca-4e4e-b5b5-9d5c105e583c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031082 Aug 07 22:42:18.403153 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 273/525] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:42:19.209458 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-4fc68ea3-1582-4aea-b85d-1bd389b856eb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:19.212897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-4fc68ea3-1582-4aea-b85d-1bd389b856eb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:19.216597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4fc68ea3-1582-4aea-b85d-1bd389b856eb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:19.217081 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4fc68ea3-1582-4aea-b85d-1bd389b856eb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:19.217521 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4fc68ea3-1582-4aea-b85d-1bd389b856eb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:19.218216 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4fc68ea3-1582-4aea-b85d-1bd389b856eb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:19.218705 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4fc68ea3-1582-4aea-b85d-1bd389b856eb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:19.219138 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4fc68ea3-1582-4aea-b85d-1bd389b856eb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:19.234146 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:19.475150 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-4fc68ea3-1582-4aea-b85d-1bd389b856eb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:19.482975 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-4fc68ea3-1582-4aea-b85d-1bd389b856eb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:19.484503 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-4fc68ea3-1582-4aea-b85d-1bd389b856eb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:19.485638 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-4fc68ea3-1582-4aea-b85d-1bd389b856eb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1408 microversion: 2.20 time: 0.280214 Aug 07 22:42:19.486192 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 253/526] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:42:19 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1408 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:42:20.509828 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-dbc072ab-c874-493e-acf1-7c763e6d1d35 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:20.510771 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-dbc072ab-c874-493e-acf1-7c763e6d1d35 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:20.516876 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dbc072ab-c874-493e-acf1-7c763e6d1d35 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:20.517351 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dbc072ab-c874-493e-acf1-7c763e6d1d35 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:20.517795 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dbc072ab-c874-493e-acf1-7c763e6d1d35 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:20.518459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dbc072ab-c874-493e-acf1-7c763e6d1d35 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:20.518913 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dbc072ab-c874-493e-acf1-7c763e6d1d35 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:20.519334 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dbc072ab-c874-493e-acf1-7c763e6d1d35 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:20.696495 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-dbc072ab-c874-493e-acf1-7c763e6d1d35 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:20.704367 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-dbc072ab-c874-493e-acf1-7c763e6d1d35 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:20.705873 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-dbc072ab-c874-493e-acf1-7c763e6d1d35 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:20.706959 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-dbc072ab-c874-493e-acf1-7c763e6d1d35 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1408 microversion: 2.20 time: 0.202745 Aug 07 22:42:20.707505 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 274/527] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:42:20 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1408 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:42:21.729767 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-37f3a067-a63f-4e69-9d54-a52857fea3cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:21.730381 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-37f3a067-a63f-4e69-9d54-a52857fea3cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:21.736930 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-37f3a067-a63f-4e69-9d54-a52857fea3cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:21.737361 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-37f3a067-a63f-4e69-9d54-a52857fea3cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:21.737808 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-37f3a067-a63f-4e69-9d54-a52857fea3cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:21.738497 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-37f3a067-a63f-4e69-9d54-a52857fea3cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:21.738954 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-37f3a067-a63f-4e69-9d54-a52857fea3cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:21.739378 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-37f3a067-a63f-4e69-9d54-a52857fea3cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:21.867519 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-37f3a067-a63f-4e69-9d54-a52857fea3cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:21.875526 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-37f3a067-a63f-4e69-9d54-a52857fea3cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:21.877064 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-37f3a067-a63f-4e69-9d54-a52857fea3cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:21.878153 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-37f3a067-a63f-4e69-9d54-a52857fea3cc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1408 microversion: 2.20 time: 0.152316 Aug 07 22:42:21.878714 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 254/528] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:42:21 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:42:22.901536 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-57dfd011-4d2e-48dc-a02e-d53fcfdbd46e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:22.902144 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-57dfd011-4d2e-48dc-a02e-d53fcfdbd46e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:22.908563 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-57dfd011-4d2e-48dc-a02e-d53fcfdbd46e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:22.909042 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-57dfd011-4d2e-48dc-a02e-d53fcfdbd46e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:22.909483 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-57dfd011-4d2e-48dc-a02e-d53fcfdbd46e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:22.910170 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-57dfd011-4d2e-48dc-a02e-d53fcfdbd46e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:22.910624 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-57dfd011-4d2e-48dc-a02e-d53fcfdbd46e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:22.911053 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-57dfd011-4d2e-48dc-a02e-d53fcfdbd46e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:23.039270 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-57dfd011-4d2e-48dc-a02e-d53fcfdbd46e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:23.047272 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-57dfd011-4d2e-48dc-a02e-d53fcfdbd46e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:23.048826 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-57dfd011-4d2e-48dc-a02e-d53fcfdbd46e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:23.049928 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-57dfd011-4d2e-48dc-a02e-d53fcfdbd46e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1408 microversion: 2.20 time: 0.152305 Aug 07 22:42:23.050504 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 275/529] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:42:22 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:42:24.073385 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-fa95b987-a6ce-44eb-a0ab-392d196ebac4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:24.073969 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-fa95b987-a6ce-44eb-a0ab-392d196ebac4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:24.076242 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=2 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:24.081932 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fa95b987-a6ce-44eb-a0ab-392d196ebac4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:24.082521 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fa95b987-a6ce-44eb-a0ab-392d196ebac4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:24.082974 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fa95b987-a6ce-44eb-a0ab-392d196ebac4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:24.083989 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fa95b987-a6ce-44eb-a0ab-392d196ebac4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:24.085007 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fa95b987-a6ce-44eb-a0ab-392d196ebac4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:24.085534 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fa95b987-a6ce-44eb-a0ab-392d196ebac4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:24.119718 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-9d90e247-df8d-4862-a22a-0a044eb693fa req-058c527f-1bee-425d-b2d8-0b81866880ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cef2464-0337-4fbd-a727-a24160f14f99", "name": "network-vif-plugged", "status": "completed", "tag": "28f8e101-7a4a-4833-b344-83657618e970"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:42:24.126575 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=2 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:24.127225 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=10 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:24.132567 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-9d90e247-df8d-4862-a22a-0a044eb693fa req-058c527f-1bee-425d-b2d8-0b81866880ad service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:24.133042 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-9d90e247-df8d-4862-a22a-0a044eb693fa req-058c527f-1bee-425d-b2d8-0b81866880ad service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:24.133489 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-9d90e247-df8d-4862-a22a-0a044eb693fa req-058c527f-1bee-425d-b2d8-0b81866880ad service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:24.144947 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-9d90e247-df8d-4862-a22a-0a044eb693fa req-058c527f-1bee-425d-b2d8-0b81866880ad service nova] Creating event network-vif-plugged:28f8e101-7a4a-4833-b344-83657618e970 for instance 9cef2464-0337-4fbd-a727-a24160f14f99 on hv-cinder-85032 Aug 07 22:42:24.160319 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-9d90e247-df8d-4862-a22a-0a044eb693fa req-058c527f-1bee-425d-b2d8-0b81866880ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044477 Aug 07 22:42:24.161065 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 276/530] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:42:24.264453 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-fa95b987-a6ce-44eb-a0ab-392d196ebac4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:24.272354 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-fa95b987-a6ce-44eb-a0ab-392d196ebac4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:24.273899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-fa95b987-a6ce-44eb-a0ab-392d196ebac4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:24.274984 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-fa95b987-a6ce-44eb-a0ab-392d196ebac4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1408 microversion: 2.20 time: 0.205578 Aug 07 22:42:24.275548 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 255/531] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:42:24 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:42:25.298993 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f2ab7f4a-a1cb-4d87-a720-ee44f626b2e6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:25.299812 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f2ab7f4a-a1cb-4d87-a720-ee44f626b2e6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:25.306863 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f2ab7f4a-a1cb-4d87-a720-ee44f626b2e6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:25.307342 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f2ab7f4a-a1cb-4d87-a720-ee44f626b2e6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:25.307777 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f2ab7f4a-a1cb-4d87-a720-ee44f626b2e6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:25.308496 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f2ab7f4a-a1cb-4d87-a720-ee44f626b2e6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:25.308947 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f2ab7f4a-a1cb-4d87-a720-ee44f626b2e6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:25.309366 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f2ab7f4a-a1cb-4d87-a720-ee44f626b2e6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:25.440866 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f2ab7f4a-a1cb-4d87-a720-ee44f626b2e6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:25.449472 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f2ab7f4a-a1cb-4d87-a720-ee44f626b2e6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:25.451024 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f2ab7f4a-a1cb-4d87-a720-ee44f626b2e6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:25.452139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f2ab7f4a-a1cb-4d87-a720-ee44f626b2e6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1408 microversion: 2.20 time: 0.157866 Aug 07 22:42:25.452699 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 277/532] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:42:25 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:42:26.475456 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d85c7645-9b5e-4924-a34d-d2ba44c8524c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:26.476121 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-d85c7645-9b5e-4924-a34d-d2ba44c8524c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:26.482281 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d85c7645-9b5e-4924-a34d-d2ba44c8524c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:26.482866 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d85c7645-9b5e-4924-a34d-d2ba44c8524c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:26.483287 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d85c7645-9b5e-4924-a34d-d2ba44c8524c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:26.483980 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d85c7645-9b5e-4924-a34d-d2ba44c8524c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:26.484472 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d85c7645-9b5e-4924-a34d-d2ba44c8524c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:26.484897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d85c7645-9b5e-4924-a34d-d2ba44c8524c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:26.626614 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-d85c7645-9b5e-4924-a34d-d2ba44c8524c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:26.635394 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-d85c7645-9b5e-4924-a34d-d2ba44c8524c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:26.637020 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-d85c7645-9b5e-4924-a34d-d2ba44c8524c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:26.638314 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-d85c7645-9b5e-4924-a34d-d2ba44c8524c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1599 microversion: 2.20 time: 0.167290 Aug 07 22:42:26.638971 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 256/533] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:42:26 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:42:26.661756 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a2ca13d1-58dd-45c9-8277-9fc7492478be tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:26.662866 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a2ca13d1-58dd-45c9-8277-9fc7492478be tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:26.669340 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a2ca13d1-58dd-45c9-8277-9fc7492478be tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:26.669887 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a2ca13d1-58dd-45c9-8277-9fc7492478be tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:26.670390 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a2ca13d1-58dd-45c9-8277-9fc7492478be tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:26.671154 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a2ca13d1-58dd-45c9-8277-9fc7492478be tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:26.671605 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a2ca13d1-58dd-45c9-8277-9fc7492478be tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:26.672042 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a2ca13d1-58dd-45c9-8277-9fc7492478be tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:26.749391 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a2ca13d1-58dd-45c9-8277-9fc7492478be tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092264 Aug 07 22:42:26.750053 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 278/534] 10.222.0.30 () {60 vars in 1316 bytes} [Sun Aug 7 22:42:26 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:42:27.991779 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-d9fffff8-f630-4a5b-bc90-3de90652fc63 req-ded75414-3b9b-4f8d-a166-279d54eeb96f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cef2464-0337-4fbd-a727-a24160f14f99", "tag": "28f8e101-7a4a-4833-b344-83657618e970"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:42:28.001515 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-d9fffff8-f630-4a5b-bc90-3de90652fc63 req-ded75414-3b9b-4f8d-a166-279d54eeb96f service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:28.001983 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-d9fffff8-f630-4a5b-bc90-3de90652fc63 req-ded75414-3b9b-4f8d-a166-279d54eeb96f service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:28.002404 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-d9fffff8-f630-4a5b-bc90-3de90652fc63 req-ded75414-3b9b-4f8d-a166-279d54eeb96f service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:28.013363 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-d9fffff8-f630-4a5b-bc90-3de90652fc63 req-ded75414-3b9b-4f8d-a166-279d54eeb96f service nova] Creating event network-changed:28f8e101-7a4a-4833-b344-83657618e970 for instance 9cef2464-0337-4fbd-a727-a24160f14f99 on hv-cinder-85032 Aug 07 22:42:28.018357 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-d9fffff8-f630-4a5b-bc90-3de90652fc63 req-ded75414-3b9b-4f8d-a166-279d54eeb96f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030304 Aug 07 22:42:28.018952 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 257/535] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:42:38.093374 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:38.094129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:38.098079 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-8f559e1e-c625-44da-a949-8dfaf4e1f490 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:38.103245 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-8f559e1e-c625-44da-a949-8dfaf4e1f490 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:38.105103 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8f559e1e-c625-44da-a949-8dfaf4e1f490 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:38.105571 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8f559e1e-c625-44da-a949-8dfaf4e1f490 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:38.106001 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8f559e1e-c625-44da-a949-8dfaf4e1f490 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:38.106674 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8f559e1e-c625-44da-a949-8dfaf4e1f490 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:38.107196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8f559e1e-c625-44da-a949-8dfaf4e1f490 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:38.107610 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8f559e1e-c625-44da-a949-8dfaf4e1f490 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:38.195265 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.objects.instance [None req-8f559e1e-c625-44da-a949-8dfaf4e1f490 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lazy-loading 'services' on Instance uuid 62959a95-0c79-4d83-a375-147271e53ffa {{(pid=129964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:42:38.457727 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-8f559e1e-c625-44da-a949-8dfaf4e1f490 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "DELETE /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa/os-volume_attachments/d0058be8-4f43-47bb-beec-e4224e99a5a7" status: 202 len: 0 microversion: 2.1 time: 0.365485 Aug 07 22:42:38.458313 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 279/536] 10.222.0.30 () {58 vars in 1416 bytes} [Sun Aug 7 22:42:38 2022] DELETE /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa/os-volume_attachments/d0058be8-4f43-47bb-beec-e4224e99a5a7 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:42:38.465171 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=13 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:38.465925 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=23 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:42:38.470313 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-383b7034-f0f8-4fc1-b1aa-e7e54e39989a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:38.472577 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-383b7034-f0f8-4fc1-b1aa-e7e54e39989a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:38.479257 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-383b7034-f0f8-4fc1-b1aa-e7e54e39989a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:38.479799 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-383b7034-f0f8-4fc1-b1aa-e7e54e39989a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:38.480208 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-383b7034-f0f8-4fc1-b1aa-e7e54e39989a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:38.480902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-383b7034-f0f8-4fc1-b1aa-e7e54e39989a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:38.481357 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-383b7034-f0f8-4fc1-b1aa-e7e54e39989a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:38.481779 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-383b7034-f0f8-4fc1-b1aa-e7e54e39989a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:38.510723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-383b7034-f0f8-4fc1-b1aa-e7e54e39989a tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046808 Aug 07 22:42:38.511272 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 258/537] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 22:42:38 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:42:39.524269 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-75351e1a-fa8d-48c8-b87a-a52b205e0418 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:39.526650 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-75351e1a-fa8d-48c8-b87a-a52b205e0418 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:39.532955 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-75351e1a-fa8d-48c8-b87a-a52b205e0418 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:39.533427 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-75351e1a-fa8d-48c8-b87a-a52b205e0418 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:39.533853 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-75351e1a-fa8d-48c8-b87a-a52b205e0418 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:39.534532 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-75351e1a-fa8d-48c8-b87a-a52b205e0418 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:39.535135 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-75351e1a-fa8d-48c8-b87a-a52b205e0418 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:39.535675 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-75351e1a-fa8d-48c8-b87a-a52b205e0418 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:39.567925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-75351e1a-fa8d-48c8-b87a-a52b205e0418 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048776 Aug 07 22:42:39.568528 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 280/538] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 22:42:39 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 22:42:39.645619 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-2e2256b5-82cd-4ec6-8e9c-f041aff446d7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:39.646255 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-2e2256b5-82cd-4ec6-8e9c-f041aff446d7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:39.654866 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2e2256b5-82cd-4ec6-8e9c-f041aff446d7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:39.655346 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2e2256b5-82cd-4ec6-8e9c-f041aff446d7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:39.655784 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2e2256b5-82cd-4ec6-8e9c-f041aff446d7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:39.656599 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2e2256b5-82cd-4ec6-8e9c-f041aff446d7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:39.657055 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2e2256b5-82cd-4ec6-8e9c-f041aff446d7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:39.657483 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2e2256b5-82cd-4ec6-8e9c-f041aff446d7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:39.683561 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-2e2256b5-82cd-4ec6-8e9c-f041aff446d7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Going to try to terminate instance {{(pid=129965) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 22:42:39.933072 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-2e2256b5-82cd-4ec6-8e9c-f041aff446d7 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "DELETE /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 204 len: 0 microversion: 2.1 time: 0.290998 Aug 07 22:42:39.933671 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 259/539] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:42:39 2022] DELETE /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 22:42:39.941798 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-db64e4a3-c668-44d8-b465-626da49c5db0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:39.943938 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-db64e4a3-c668-44d8-b465-626da49c5db0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:39.949087 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-db64e4a3-c668-44d8-b465-626da49c5db0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:39.949570 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-db64e4a3-c668-44d8-b465-626da49c5db0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:39.950004 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-db64e4a3-c668-44d8-b465-626da49c5db0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:39.950692 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-db64e4a3-c668-44d8-b465-626da49c5db0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:39.951145 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-db64e4a3-c668-44d8-b465-626da49c5db0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:39.951561 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-db64e4a3-c668-44d8-b465-626da49c5db0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:40.079959 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-db64e4a3-c668-44d8-b465-626da49c5db0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:40.088203 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-db64e4a3-c668-44d8-b465-626da49c5db0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1688 microversion: 2.1 time: 0.150355 Aug 07 22:42:40.088772 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 281/540] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:42:39 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:42:41.109904 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-f6e0cc32-0c21-4ebe-a0b4-0f34593fa875 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:41.110656 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-f6e0cc32-0c21-4ebe-a0b4-0f34593fa875 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:41.117198 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f6e0cc32-0c21-4ebe-a0b4-0f34593fa875 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:41.117700 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f6e0cc32-0c21-4ebe-a0b4-0f34593fa875 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:41.118139 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f6e0cc32-0c21-4ebe-a0b4-0f34593fa875 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:41.118824 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f6e0cc32-0c21-4ebe-a0b4-0f34593fa875 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:41.119275 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f6e0cc32-0c21-4ebe-a0b4-0f34593fa875 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:41.119704 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f6e0cc32-0c21-4ebe-a0b4-0f34593fa875 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:41.250439 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f6e0cc32-0c21-4ebe-a0b4-0f34593fa875 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:41.260844 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-f6e0cc32-0c21-4ebe-a0b4-0f34593fa875 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1688 microversion: 2.1 time: 0.154675 Aug 07 22:42:41.261684 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 260/541] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:42:41 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:42:42.281101 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-54a62c33-0ab1-4585-a6cb-0782f351e5f9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:42.281710 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-54a62c33-0ab1-4585-a6cb-0782f351e5f9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:42.288208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-54a62c33-0ab1-4585-a6cb-0782f351e5f9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:42.289266 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-54a62c33-0ab1-4585-a6cb-0782f351e5f9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:42.289708 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-54a62c33-0ab1-4585-a6cb-0782f351e5f9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:42.290415 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-54a62c33-0ab1-4585-a6cb-0782f351e5f9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:42.290868 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-54a62c33-0ab1-4585-a6cb-0782f351e5f9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:42.291294 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-54a62c33-0ab1-4585-a6cb-0782f351e5f9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:42.424251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-54a62c33-0ab1-4585-a6cb-0782f351e5f9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:42.432115 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-54a62c33-0ab1-4585-a6cb-0782f351e5f9 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1688 microversion: 2.1 time: 0.154796 Aug 07 22:42:42.432781 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 282/542] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:42:42 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:42:43.453878 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-50b6a2a7-d491-47ad-93ea-98694ac08f28 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:43.454446 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-50b6a2a7-d491-47ad-93ea-98694ac08f28 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:43.461984 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-50b6a2a7-d491-47ad-93ea-98694ac08f28 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:43.462464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-50b6a2a7-d491-47ad-93ea-98694ac08f28 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:43.462898 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-50b6a2a7-d491-47ad-93ea-98694ac08f28 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:43.463584 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-50b6a2a7-d491-47ad-93ea-98694ac08f28 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:43.464052 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-50b6a2a7-d491-47ad-93ea-98694ac08f28 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:43.464477 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-50b6a2a7-d491-47ad-93ea-98694ac08f28 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:43.596309 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-50b6a2a7-d491-47ad-93ea-98694ac08f28 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:43.601533 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-50b6a2a7-d491-47ad-93ea-98694ac08f28 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1688 microversion: 2.1 time: 0.151483 Aug 07 22:42:43.602112 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 261/543] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:42:43 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:42:44.550036 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-2eae8f8a-cce3-4db3-89dc-b6954c0b5243 req-4da24719-6235-41d8-9b99-88b65f2cb890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62959a95-0c79-4d83-a375-147271e53ffa", "name": "network-vif-deleted", "tag": "ffa75a68-45f7-47ee-941b-97d714ef438e"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:42:44.559797 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-2eae8f8a-cce3-4db3-89dc-b6954c0b5243 req-4da24719-6235-41d8-9b99-88b65f2cb890 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:44.560153 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-2eae8f8a-cce3-4db3-89dc-b6954c0b5243 req-4da24719-6235-41d8-9b99-88b65f2cb890 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:44.560538 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-2eae8f8a-cce3-4db3-89dc-b6954c0b5243 req-4da24719-6235-41d8-9b99-88b65f2cb890 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:44.572693 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-2eae8f8a-cce3-4db3-89dc-b6954c0b5243 req-4da24719-6235-41d8-9b99-88b65f2cb890 service nova] Creating event network-vif-deleted:ffa75a68-45f7-47ee-941b-97d714ef438e for instance 62959a95-0c79-4d83-a375-147271e53ffa on hv-cinder-85032 Aug 07 22:42:44.577751 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-2eae8f8a-cce3-4db3-89dc-b6954c0b5243 req-4da24719-6235-41d8-9b99-88b65f2cb890 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032151 Aug 07 22:42:44.581322 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 283/544] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:42:44.624306 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-a123c5e3-267c-4e66-8c73-61bc53a1f096 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:44.624986 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-a123c5e3-267c-4e66-8c73-61bc53a1f096 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:44.631944 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a123c5e3-267c-4e66-8c73-61bc53a1f096 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:44.634004 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a123c5e3-267c-4e66-8c73-61bc53a1f096 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:44.634452 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a123c5e3-267c-4e66-8c73-61bc53a1f096 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:44.635589 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a123c5e3-267c-4e66-8c73-61bc53a1f096 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:44.636238 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a123c5e3-267c-4e66-8c73-61bc53a1f096 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:44.636669 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a123c5e3-267c-4e66-8c73-61bc53a1f096 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:44.710828 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-a123c5e3-267c-4e66-8c73-61bc53a1f096 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:44.730897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-a123c5e3-267c-4e66-8c73-61bc53a1f096 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 200 len: 1621 microversion: 2.1 time: 0.111837 Aug 07 22:42:44.735089 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 262/545] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:42:44 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 1621 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:42:45.753255 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-4ef1b85f-1446-4334-afeb-0c05d9548db1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:45.753952 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-4ef1b85f-1446-4334-afeb-0c05d9548db1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 62959a95-0c79-4d83-a375-147271e53ffa] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:45.760984 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4ef1b85f-1446-4334-afeb-0c05d9548db1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:45.761469 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4ef1b85f-1446-4334-afeb-0c05d9548db1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:45.761903 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4ef1b85f-1446-4334-afeb-0c05d9548db1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:45.762592 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4ef1b85f-1446-4334-afeb-0c05d9548db1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:45.763046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4ef1b85f-1446-4334-afeb-0c05d9548db1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:45.763471 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4ef1b85f-1446-4334-afeb-0c05d9548db1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:45.776759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-4ef1b85f-1446-4334-afeb-0c05d9548db1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] HTTP exception thrown: Instance 62959a95-0c79-4d83-a375-147271e53ffa could not be found. Aug 07 22:42:45.778379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-4ef1b85f-1446-4334-afeb-0c05d9548db1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Request method failure captured: Aug 07 22:42:45.778379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa HTTP/1.1 Aug 07 22:42:45.778379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:42:45.778379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:42:45.778379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:42:45.778379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:42:45.778379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:42:45.778379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:42:45.778379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:42:45.778379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:42:45.778379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8D6s5nO1c7U2MmqVI63h0n43WSrk5CGbs2YynnGh_TABx-q8rxIYvsMGcCP7Nv7JfrcY16P7N3JNnFncFS0_mt8rJCMseLlgBlfUb-RWx8wwGc9OQ2mOe8HxAwiKpQ0fBBAk_n596Ofhngwl4r_Hz2hQEOMQxV8vDBZueD9nBUbzfMg Aug 07 22:42:45.778379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:42:45.778379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:42:45.778379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:42:45.778379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:42:45.778379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:42:45.778379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:42:45.778379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 1a78ad9d7151473798fbefa330678250 Aug 07 22:42:45.778379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-755269189 Aug 07 22:42:45.778379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:42:45.778379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:42:45.779961 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1a78ad9d7151473798fbefa330678250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1a78ad9d7151473798fbefa330678250"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1a78ad9d7151473798fbefa330678250"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1a78ad9d7151473798fbefa330678250"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:42:45.779961 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-ServerRescueNegativeTestJSON-755269189 Aug 07 22:42:45.779961 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 1a78ad9d7151473798fbefa330678250 Aug 07 22:42:45.779961 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-755269189 Aug 07 22:42:45.779961 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-ServerRescueNegativeTestJSON-755269189-project Aug 07 22:42:45.779961 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:42:45.779961 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:42:45.779961 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: 966045fbe69f43b4b1a825da3ad571b9 Aug 07 22:42:45.779961 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-ServerRescueNegativeTestJSON-755269189-project Aug 07 22:42:45.779961 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: > Aug 07 22:42:45.779961 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Instance 62959a95-0c79-4d83-a375-147271e53ffa could not be found. Aug 07 22:42:45.779961 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': '62959a95-0c79-4d83-a375-147271e53ffa'} Aug 07 22:42:45.780799 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:42:45.780799 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:42:45.780799 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:42:45.780799 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:42:45.780799 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:42:45.780799 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:42:45.780799 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:42:45.780799 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:42:45.780799 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:42:45.780799 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:42:45.780799 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62959a95-0c79-4d83-a375-147271e53ffa could not be found. Aug 07 22:42:45.780799 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:42:45.780799 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:42:45.780799 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:42:45.780799 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:42:45.780799 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:42:45.780799 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:42:45.780799 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:42:45.780799 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:42:45.780799 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:42:45.782223 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:42:45.782223 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:42:45.782223 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:42:45.782223 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:42:45.782223 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:42:45.782223 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:42:45.782223 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:42:45.782223 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62959a95-0c79-4d83-a375-147271e53ffa could not be found. Aug 07 22:42:45.782223 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:42:45.782223 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:42:45.782223 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:42:45.782223 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:42:45.782223 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:42:45.782223 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:42:45.782223 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:42:45.782223 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:42:45.782223 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62959a95-0c79-4d83-a375-147271e53ffa could not be found. Aug 07 22:42:45.782223 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:42:45.784075 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-4ef1b85f-1446-4334-afeb-0c05d9548db1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Returning 404 to user: Instance 62959a95-0c79-4d83-a375-147271e53ffa could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:42:45.784075 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-4ef1b85f-1446-4334-afeb-0c05d9548db1 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa" status: 404 len: 111 microversion: 2.1 time: 0.031169 Aug 07 22:42:45.784075 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 284/546] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:42:45 2022] GET /compute/v2.1/servers/62959a95-0c79-4d83-a375-147271e53ffa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:42:45.788513 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-c76fdbfd-76d4-48d4-ba12-6d5aaa5aedf3 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '.version_select at 0x7fc0ac4d0790>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:45.887033 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-c76fdbfd-76d4-48d4-ba12-6d5aaa5aedf3 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-940536888" status: 202 len: 0 microversion: 2.1 time: 0.102383 Aug 07 22:42:45.887616 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 263/547] 10.222.0.30 () {58 vars in 1218 bytes} [Sun Aug 7 22:42:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-940536888 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:42:52.335268 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a18e08c5-143e-4e54-bd54-d0e83f9953ae tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:52.336650 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a18e08c5-143e-4e54-bd54-d0e83f9953ae tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:52.342475 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a18e08c5-143e-4e54-bd54-d0e83f9953ae tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:52.342948 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a18e08c5-143e-4e54-bd54-d0e83f9953ae tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:52.343383 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a18e08c5-143e-4e54-bd54-d0e83f9953ae tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:52.344112 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a18e08c5-143e-4e54-bd54-d0e83f9953ae tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:52.344564 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a18e08c5-143e-4e54-bd54-d0e83f9953ae tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:52.344985 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a18e08c5-143e-4e54-bd54-d0e83f9953ae tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:52.370811 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a18e08c5-143e-4e54-bd54-d0e83f9953ae tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Going to try to terminate instance {{(pid=129964) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 22:42:52.616930 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a18e08c5-143e-4e54-bd54-d0e83f9953ae tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "DELETE /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 204 len: 0 microversion: 2.1 time: 0.285101 Aug 07 22:42:52.617546 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 285/548] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:42:52 2022] DELETE /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 22:42:52.626007 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-56a7f543-cf48-4515-9dc4-ae9f02870064 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:52.626653 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-56a7f543-cf48-4515-9dc4-ae9f02870064 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:52.633580 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-56a7f543-cf48-4515-9dc4-ae9f02870064 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:52.634062 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-56a7f543-cf48-4515-9dc4-ae9f02870064 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:52.634527 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-56a7f543-cf48-4515-9dc4-ae9f02870064 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:52.635462 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-56a7f543-cf48-4515-9dc4-ae9f02870064 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:52.635929 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-56a7f543-cf48-4515-9dc4-ae9f02870064 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:52.636391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-56a7f543-cf48-4515-9dc4-ae9f02870064 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:52.767370 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-56a7f543-cf48-4515-9dc4-ae9f02870064 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:52.775778 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-56a7f543-cf48-4515-9dc4-ae9f02870064 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1507 microversion: 2.1 time: 0.154241 Aug 07 22:42:52.776373 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 264/549] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:42:52 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:42:53.797563 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-77e5d68d-ac07-4968-b3ac-82ac03c8bd82 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:53.798339 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-77e5d68d-ac07-4968-b3ac-82ac03c8bd82 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:53.804918 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-77e5d68d-ac07-4968-b3ac-82ac03c8bd82 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:53.805423 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-77e5d68d-ac07-4968-b3ac-82ac03c8bd82 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:53.805853 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-77e5d68d-ac07-4968-b3ac-82ac03c8bd82 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:53.806534 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-77e5d68d-ac07-4968-b3ac-82ac03c8bd82 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:53.806983 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-77e5d68d-ac07-4968-b3ac-82ac03c8bd82 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:53.807405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-77e5d68d-ac07-4968-b3ac-82ac03c8bd82 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:53.943924 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-77e5d68d-ac07-4968-b3ac-82ac03c8bd82 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:53.952148 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-77e5d68d-ac07-4968-b3ac-82ac03c8bd82 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1507 microversion: 2.1 time: 0.158875 Aug 07 22:42:53.952710 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 286/550] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:42:53 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:42:54.972973 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-13227604-5251-4b40-a365-040ba30fa666 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:54.973586 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-13227604-5251-4b40-a365-040ba30fa666 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:54.981564 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-13227604-5251-4b40-a365-040ba30fa666 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:54.982081 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-13227604-5251-4b40-a365-040ba30fa666 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:54.982538 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-13227604-5251-4b40-a365-040ba30fa666 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:54.983270 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-13227604-5251-4b40-a365-040ba30fa666 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:54.983726 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-13227604-5251-4b40-a365-040ba30fa666 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:54.984173 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-13227604-5251-4b40-a365-040ba30fa666 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:55.158204 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-13227604-5251-4b40-a365-040ba30fa666 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:55.166145 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-13227604-5251-4b40-a365-040ba30fa666 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1507 microversion: 2.1 time: 0.197020 Aug 07 22:42:55.166729 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 265/551] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:42:54 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1507 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:42:55.841506 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-836184be-5000-418a-bcc1-14b0567522b9 req-757a05b1-5849-4bf0-8ddf-aaf38b3dc8a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39340b52-40cd-4de1-a055-2ad5d71a6598", "name": "network-vif-deleted", "tag": "3ebb913e-d05d-414e-9214-6fe46a403f13"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:42:55.853311 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-836184be-5000-418a-bcc1-14b0567522b9 req-757a05b1-5849-4bf0-8ddf-aaf38b3dc8a5 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:55.853865 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-836184be-5000-418a-bcc1-14b0567522b9 req-757a05b1-5849-4bf0-8ddf-aaf38b3dc8a5 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:55.854316 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-836184be-5000-418a-bcc1-14b0567522b9 req-757a05b1-5849-4bf0-8ddf-aaf38b3dc8a5 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:55.865464 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-836184be-5000-418a-bcc1-14b0567522b9 req-757a05b1-5849-4bf0-8ddf-aaf38b3dc8a5 service nova] Creating event network-vif-deleted:3ebb913e-d05d-414e-9214-6fe46a403f13 for instance 39340b52-40cd-4de1-a055-2ad5d71a6598 on hv-cinder-85032 Aug 07 22:42:55.871021 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-836184be-5000-418a-bcc1-14b0567522b9 req-757a05b1-5849-4bf0-8ddf-aaf38b3dc8a5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165616 Aug 07 22:42:55.871694 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 287/552] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:42:56.187722 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ec33c4de-ccad-4276-8dec-ec39566b27c0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:56.188276 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-ec33c4de-ccad-4276-8dec-ec39566b27c0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:56.194758 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ec33c4de-ccad-4276-8dec-ec39566b27c0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:56.195374 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ec33c4de-ccad-4276-8dec-ec39566b27c0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:56.195801 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ec33c4de-ccad-4276-8dec-ec39566b27c0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:56.196572 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ec33c4de-ccad-4276-8dec-ec39566b27c0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:56.197022 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ec33c4de-ccad-4276-8dec-ec39566b27c0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:56.197439 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ec33c4de-ccad-4276-8dec-ec39566b27c0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:56.232164 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ec33c4de-ccad-4276-8dec-ec39566b27c0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:56.232689 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ec33c4de-ccad-4276-8dec-ec39566b27c0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:56.233130 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ec33c4de-ccad-4276-8dec-ec39566b27c0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:56.233597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.objects.instance [None req-ec33c4de-ccad-4276-8dec-ec39566b27c0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lazy-loading 'fault' on Instance uuid 39340b52-40cd-4de1-a055-2ad5d71a6598 {{(pid=129965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:42:56.278509 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-ec33c4de-ccad-4276-8dec-ec39566b27c0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:56.286142 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-ec33c4de-ccad-4276-8dec-ec39566b27c0 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 200 len: 1311 microversion: 2.1 time: 0.102465 Aug 07 22:42:56.286712 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 266/553] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:42:56 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:42:57.316614 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f9f13a0e-872a-432e-9d7b-eb048104bba8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:57.317297 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f9f13a0e-872a-432e-9d7b-eb048104bba8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: 39340b52-40cd-4de1-a055-2ad5d71a6598] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:57.326508 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f9f13a0e-872a-432e-9d7b-eb048104bba8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:57.326508 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f9f13a0e-872a-432e-9d7b-eb048104bba8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:57.326508 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f9f13a0e-872a-432e-9d7b-eb048104bba8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:57.326508 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f9f13a0e-872a-432e-9d7b-eb048104bba8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:57.326924 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f9f13a0e-872a-432e-9d7b-eb048104bba8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:57.327087 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f9f13a0e-872a-432e-9d7b-eb048104bba8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:57.341269 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-f9f13a0e-872a-432e-9d7b-eb048104bba8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] HTTP exception thrown: Instance 39340b52-40cd-4de1-a055-2ad5d71a6598 could not be found. Aug 07 22:42:57.343243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f9f13a0e-872a-432e-9d7b-eb048104bba8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Request method failure captured: Aug 07 22:42:57.343243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 HTTP/1.1 Aug 07 22:42:57.343243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:42:57.343243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:42:57.343243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:42:57.343243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:42:57.343243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:42:57.343243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:42:57.343243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:42:57.343243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:42:57.343243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8D6s5nO1c7U2MmqVI63h0n43WSrk5CGbs2YynnGh_TABx-q8rxIYvsMGcCP7Nv7JfrcY16P7N3JNnFncFS0_mt8rJCMseLlgBlfUb-RWx8wwGc9OQ2mOe8HxAwiKpQ0fBBAk_n596Ofhngwl4r_Hz2hQEOMQxV8vDBZueD9nBUbzfMg Aug 07 22:42:57.343243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:42:57.343243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:42:57.343243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:42:57.343243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:42:57.343243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:42:57.343243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:42:57.343243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 1a78ad9d7151473798fbefa330678250 Aug 07 22:42:57.343243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-755269189 Aug 07 22:42:57.343243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:42:57.343243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:42:57.344896 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1a78ad9d7151473798fbefa330678250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1a78ad9d7151473798fbefa330678250"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1a78ad9d7151473798fbefa330678250"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1a78ad9d7151473798fbefa330678250"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:42:57.344896 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-ServerRescueNegativeTestJSON-755269189 Aug 07 22:42:57.344896 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 1a78ad9d7151473798fbefa330678250 Aug 07 22:42:57.344896 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-755269189 Aug 07 22:42:57.344896 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-ServerRescueNegativeTestJSON-755269189-project Aug 07 22:42:57.344896 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:42:57.344896 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:42:57.344896 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: 966045fbe69f43b4b1a825da3ad571b9 Aug 07 22:42:57.344896 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-ServerRescueNegativeTestJSON-755269189-project Aug 07 22:42:57.344896 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: > Aug 07 22:42:57.344896 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Instance 39340b52-40cd-4de1-a055-2ad5d71a6598 could not be found. Aug 07 22:42:57.344896 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': '39340b52-40cd-4de1-a055-2ad5d71a6598'} Aug 07 22:42:57.345702 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:42:57.345702 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:42:57.345702 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:42:57.345702 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:42:57.345702 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:42:57.345702 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:42:57.345702 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:42:57.345702 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:42:57.345702 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:42:57.345702 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:42:57.345702 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39340b52-40cd-4de1-a055-2ad5d71a6598 could not be found. Aug 07 22:42:57.345702 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:42:57.345702 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:42:57.345702 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:42:57.345702 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:42:57.345702 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:42:57.345702 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:42:57.345702 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:42:57.345702 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:42:57.345702 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:42:57.347625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:42:57.347625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:42:57.347625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:42:57.347625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:42:57.347625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:42:57.347625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:42:57.347625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:42:57.347625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39340b52-40cd-4de1-a055-2ad5d71a6598 could not be found. Aug 07 22:42:57.347625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:42:57.347625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:42:57.347625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:42:57.347625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:42:57.347625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:42:57.347625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:42:57.347625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:42:57.347625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:42:57.347625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39340b52-40cd-4de1-a055-2ad5d71a6598 could not be found. Aug 07 22:42:57.347625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:42:57.356804 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f9f13a0e-872a-432e-9d7b-eb048104bba8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Returning 404 to user: Instance 39340b52-40cd-4de1-a055-2ad5d71a6598 could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:42:57.356804 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f9f13a0e-872a-432e-9d7b-eb048104bba8 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598" status: 404 len: 111 microversion: 2.1 time: 0.041115 Aug 07 22:42:57.356988 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-8653cf0c-a5a5-4ccb-9da7-9dbdf8452237 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:57.356988 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-8653cf0c-a5a5-4ccb-9da7-9dbdf8452237 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:57.361164 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8653cf0c-a5a5-4ccb-9da7-9dbdf8452237 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:57.361640 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8653cf0c-a5a5-4ccb-9da7-9dbdf8452237 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:57.362072 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8653cf0c-a5a5-4ccb-9da7-9dbdf8452237 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:57.362758 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8653cf0c-a5a5-4ccb-9da7-9dbdf8452237 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:57.363247 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8653cf0c-a5a5-4ccb-9da7-9dbdf8452237 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:57.363665 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8653cf0c-a5a5-4ccb-9da7-9dbdf8452237 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:57.367561 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 288/554] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:42:57 2022] GET /compute/v2.1/servers/39340b52-40cd-4de1-a055-2ad5d71a6598 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:42:57.389432 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-8653cf0c-a5a5-4ccb-9da7-9dbdf8452237 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Going to try to terminate instance {{(pid=129965) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 22:42:57.704768 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-8653cf0c-a5a5-4ccb-9da7-9dbdf8452237 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 204 len: 0 microversion: 2.1 time: 0.354635 Aug 07 22:42:57.705646 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 267/555] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:42:57 2022] DELETE /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 22:42:57.714449 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-6f9089ae-42ee-49fe-b1c3-a06f0c8a2ade tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:57.715049 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-6f9089ae-42ee-49fe-b1c3-a06f0c8a2ade tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:57.721064 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6f9089ae-42ee-49fe-b1c3-a06f0c8a2ade tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:57.721535 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6f9089ae-42ee-49fe-b1c3-a06f0c8a2ade tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:57.722149 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6f9089ae-42ee-49fe-b1c3-a06f0c8a2ade tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:57.722835 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6f9089ae-42ee-49fe-b1c3-a06f0c8a2ade tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:57.723405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6f9089ae-42ee-49fe-b1c3-a06f0c8a2ade tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:57.723691 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6f9089ae-42ee-49fe-b1c3-a06f0c8a2ade tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:57.860447 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-6f9089ae-42ee-49fe-b1c3-a06f0c8a2ade tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:57.868088 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-6f9089ae-42ee-49fe-b1c3-a06f0c8a2ade tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.158270 Aug 07 22:42:57.868644 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 289/556] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:42:57 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:42:58.890956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-dccbf8f1-29a2-4b3f-9802-560ac6e5476b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:42:58.893411 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-dccbf8f1-29a2-4b3f-9802-560ac6e5476b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:42:58.900750 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-dccbf8f1-29a2-4b3f-9802-560ac6e5476b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:58.901352 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-dccbf8f1-29a2-4b3f-9802-560ac6e5476b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:58.901853 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-dccbf8f1-29a2-4b3f-9802-560ac6e5476b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:58.902624 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-dccbf8f1-29a2-4b3f-9802-560ac6e5476b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:42:58.903142 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-dccbf8f1-29a2-4b3f-9802-560ac6e5476b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:42:58.903672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-dccbf8f1-29a2-4b3f-9802-560ac6e5476b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:42:59.047291 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-dccbf8f1-29a2-4b3f-9802-560ac6e5476b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:42:59.055871 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-dccbf8f1-29a2-4b3f-9802-560ac6e5476b tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.170541 Aug 07 22:42:59.056468 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 268/557] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:42:58 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:00.077392 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-6506da97-f7aa-4d7a-a0bf-251f730e8c2f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:00.078019 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-6506da97-f7aa-4d7a-a0bf-251f730e8c2f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:00.084447 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6506da97-f7aa-4d7a-a0bf-251f730e8c2f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:00.084929 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6506da97-f7aa-4d7a-a0bf-251f730e8c2f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:00.085636 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6506da97-f7aa-4d7a-a0bf-251f730e8c2f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:00.086336 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6506da97-f7aa-4d7a-a0bf-251f730e8c2f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:00.086870 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6506da97-f7aa-4d7a-a0bf-251f730e8c2f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:00.087201 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6506da97-f7aa-4d7a-a0bf-251f730e8c2f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:00.229460 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-6506da97-f7aa-4d7a-a0bf-251f730e8c2f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:00.238422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-6506da97-f7aa-4d7a-a0bf-251f730e8c2f tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.165110 Aug 07 22:43:00.239003 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 290/558] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:00 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:01.263607 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-a605c7db-7e2c-4a89-9997-e8eaa24b735d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:01.265177 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-a605c7db-7e2c-4a89-9997-e8eaa24b735d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:01.275438 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a605c7db-7e2c-4a89-9997-e8eaa24b735d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:01.276395 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a605c7db-7e2c-4a89-9997-e8eaa24b735d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:01.277475 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a605c7db-7e2c-4a89-9997-e8eaa24b735d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:01.278995 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a605c7db-7e2c-4a89-9997-e8eaa24b735d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:01.279760 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a605c7db-7e2c-4a89-9997-e8eaa24b735d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:01.281673 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a605c7db-7e2c-4a89-9997-e8eaa24b735d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:01.537473 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-a605c7db-7e2c-4a89-9997-e8eaa24b735d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:01.546384 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-a605c7db-7e2c-4a89-9997-e8eaa24b735d tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1521 microversion: 2.1 time: 0.289031 Aug 07 22:43:01.560121 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 269/559] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:01 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:01.841380 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-69134eaa-c1fd-4ad1-add9-1c5ba7c28a33 req-1cfa220c-21fa-44cd-9413-9ae0881d4548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e", "name": "network-vif-deleted", "tag": "8844e27d-a856-4256-bdd2-6ab7f2b8ceda"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:43:01.855627 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-69134eaa-c1fd-4ad1-add9-1c5ba7c28a33 req-1cfa220c-21fa-44cd-9413-9ae0881d4548 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:01.855627 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-69134eaa-c1fd-4ad1-add9-1c5ba7c28a33 req-1cfa220c-21fa-44cd-9413-9ae0881d4548 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:01.856044 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-69134eaa-c1fd-4ad1-add9-1c5ba7c28a33 req-1cfa220c-21fa-44cd-9413-9ae0881d4548 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:01.869518 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-69134eaa-c1fd-4ad1-add9-1c5ba7c28a33 req-1cfa220c-21fa-44cd-9413-9ae0881d4548 service nova] Creating event network-vif-deleted:8844e27d-a856-4256-bdd2-6ab7f2b8ceda for instance c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e on hv-cinder-85032 Aug 07 22:43:01.879923 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-69134eaa-c1fd-4ad1-add9-1c5ba7c28a33 req-1cfa220c-21fa-44cd-9413-9ae0881d4548 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044114 Aug 07 22:43:01.880760 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 291/560] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:43:02.566753 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-f57d5fff-3663-4d19-8e32-813c6ce24225 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:02.567356 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-f57d5fff-3663-4d19-8e32-813c6ce24225 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:02.573851 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f57d5fff-3663-4d19-8e32-813c6ce24225 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:02.574360 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f57d5fff-3663-4d19-8e32-813c6ce24225 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:02.574809 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f57d5fff-3663-4d19-8e32-813c6ce24225 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:02.575491 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f57d5fff-3663-4d19-8e32-813c6ce24225 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:02.575938 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f57d5fff-3663-4d19-8e32-813c6ce24225 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:02.579603 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f57d5fff-3663-4d19-8e32-813c6ce24225 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:02.609849 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f57d5fff-3663-4d19-8e32-813c6ce24225 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:02.610328 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f57d5fff-3663-4d19-8e32-813c6ce24225 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:02.610759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f57d5fff-3663-4d19-8e32-813c6ce24225 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:02.611197 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.objects.instance [None req-f57d5fff-3663-4d19-8e32-813c6ce24225 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lazy-loading 'fault' on Instance uuid c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e {{(pid=129965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:43:02.654351 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f57d5fff-3663-4d19-8e32-813c6ce24225 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966045fbe69f43b4b1a825da3ad571b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a78ad9d7151473798fbefa330678250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:02.661907 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-f57d5fff-3663-4d19-8e32-813c6ce24225 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 200 len: 1311 microversion: 2.1 time: 0.099195 Aug 07 22:43:02.662472 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 270/561] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:02 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:03.687618 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-d7dadaa7-7fc7-4449-8fcc-073ef6aff049 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:03.688574 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-d7dadaa7-7fc7-4449-8fcc-073ef6aff049 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] [instance: c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:03.696577 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d7dadaa7-7fc7-4449-8fcc-073ef6aff049 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:03.697452 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d7dadaa7-7fc7-4449-8fcc-073ef6aff049 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:03.697992 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d7dadaa7-7fc7-4449-8fcc-073ef6aff049 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:03.698956 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d7dadaa7-7fc7-4449-8fcc-073ef6aff049 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:03.699630 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d7dadaa7-7fc7-4449-8fcc-073ef6aff049 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:03.700303 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d7dadaa7-7fc7-4449-8fcc-073ef6aff049 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:03.714907 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-d7dadaa7-7fc7-4449-8fcc-073ef6aff049 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] HTTP exception thrown: Instance c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e could not be found. Aug 07 22:43:03.716838 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-d7dadaa7-7fc7-4449-8fcc-073ef6aff049 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Request method failure captured: Aug 07 22:43:03.716838 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e HTTP/1.1 Aug 07 22:43:03.716838 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:43:03.716838 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:43:03.716838 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:43:03.716838 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:43:03.716838 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:43:03.716838 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:43:03.716838 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:43:03.716838 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:43:03.716838 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8D6s5nO1c7U2MmqVI63h0n43WSrk5CGbs2YynnGh_TABx-q8rxIYvsMGcCP7Nv7JfrcY16P7N3JNnFncFS0_mt8rJCMseLlgBlfUb-RWx8wwGc9OQ2mOe8HxAwiKpQ0fBBAk_n596Ofhngwl4r_Hz2hQEOMQxV8vDBZueD9nBUbzfMg Aug 07 22:43:03.716838 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:43:03.716838 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:43:03.716838 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:43:03.716838 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:43:03.716838 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:43:03.716838 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:43:03.716838 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 1a78ad9d7151473798fbefa330678250 Aug 07 22:43:03.716838 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-755269189 Aug 07 22:43:03.716838 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:43:03.716838 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:43:03.718374 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1a78ad9d7151473798fbefa330678250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1a78ad9d7151473798fbefa330678250"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1a78ad9d7151473798fbefa330678250"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1a78ad9d7151473798fbefa330678250"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:43:03.718374 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-ServerRescueNegativeTestJSON-755269189 Aug 07 22:43:03.718374 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 1a78ad9d7151473798fbefa330678250 Aug 07 22:43:03.718374 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-755269189 Aug 07 22:43:03.718374 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-ServerRescueNegativeTestJSON-755269189-project Aug 07 22:43:03.718374 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:43:03.718374 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:43:03.718374 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: 966045fbe69f43b4b1a825da3ad571b9 Aug 07 22:43:03.718374 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-ServerRescueNegativeTestJSON-755269189-project Aug 07 22:43:03.718374 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: > Aug 07 22:43:03.718374 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Instance c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e could not be found. Aug 07 22:43:03.718374 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': 'c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e'} Aug 07 22:43:03.719094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:43:03.719094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:43:03.719094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:43:03.719094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:43:03.719094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:43:03.719094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:43:03.719094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:43:03.719094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:43:03.719094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:43:03.719094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:43:03.719094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e could not be found. Aug 07 22:43:03.719094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:43:03.719094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:43:03.719094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:43:03.719094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:43:03.719094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:43:03.719094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:43:03.719094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:43:03.719094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:43:03.719094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:43:03.720293 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:43:03.720293 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:43:03.720293 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:43:03.720293 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:43:03.720293 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:43:03.720293 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:43:03.720293 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:43:03.720293 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e could not be found. Aug 07 22:43:03.720293 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:43:03.720293 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:43:03.720293 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:43:03.720293 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:43:03.720293 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:43:03.720293 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:43:03.720293 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:43:03.720293 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:43:03.720293 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e could not be found. Aug 07 22:43:03.720293 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:43:03.722659 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-d7dadaa7-7fc7-4449-8fcc-073ef6aff049 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] Returning 404 to user: Instance c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:43:03.724409 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-d7dadaa7-7fc7-4449-8fcc-073ef6aff049 tempest-ServerRescueNegativeTestJSON-755269189 tempest-ServerRescueNegativeTestJSON-755269189-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e" status: 404 len: 111 microversion: 2.1 time: 0.042423 Aug 07 22:43:03.725477 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 292/562] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:03 2022] GET /compute/v2.1/servers/c7f72fa6-fffb-4feb-82ef-a06e9eb6a25e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:43:04.361439 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-80b9c18a-9879-445e-83fc-46d2af1dc09d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:04.362251 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-80b9c18a-9879-445e-83fc-46d2af1dc09d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:04.369257 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-80b9c18a-9879-445e-83fc-46d2af1dc09d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:04.370037 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-80b9c18a-9879-445e-83fc-46d2af1dc09d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:04.370671 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-80b9c18a-9879-445e-83fc-46d2af1dc09d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:04.371507 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-80b9c18a-9879-445e-83fc-46d2af1dc09d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:04.372269 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-80b9c18a-9879-445e-83fc-46d2af1dc09d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:04.372869 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-80b9c18a-9879-445e-83fc-46d2af1dc09d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:04.393598 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:04.402233 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-80b9c18a-9879-445e-83fc-46d2af1dc09d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99/ips" status: 200 len: 151 microversion: 2.20 time: 0.290934 Aug 07 22:43:04.403670 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 271/563] 10.222.0.30 () {60 vars in 1289 bytes} [Sun Aug 7 22:43:04 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99/ips => generated 151 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:43:07.203233 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-76e68f2e-6d9b-4390-92a0-448a107f991f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:43:07.203815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-76e68f2e-6d9b-4390-92a0-448a107f991f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:07.221797 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-76e68f2e-6d9b-4390-92a0-448a107f991f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:07.222357 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-76e68f2e-6d9b-4390-92a0-448a107f991f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:07.222804 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-76e68f2e-6d9b-4390-92a0-448a107f991f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:07.230477 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-76e68f2e-6d9b-4390-92a0-448a107f991f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:07.231207 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-76e68f2e-6d9b-4390-92a0-448a107f991f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:07.231867 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-76e68f2e-6d9b-4390-92a0-448a107f991f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:07.264203 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.objects.instance [None req-76e68f2e-6d9b-4390-92a0-448a107f991f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lazy-loading 'flavor' on Instance uuid 9cef2464-0337-4fbd-a727-a24160f14f99 {{(pid=129964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:43:07.893134 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-76e68f2e-6d9b-4390-92a0-448a107f991f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "POST /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99/action" status: 202 len: 0 microversion: 2.20 time: 0.694026 Aug 07 22:43:07.895130 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 293/564] 10.222.0.30 () {62 vars in 1319 bytes} [Sun Aug 7 22:43:07 2022] POST /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99/action => generated 0 bytes in 698 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 22:43:07.905586 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-fc45e57b-9230-471a-94fd-856de7e2446e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:07.906834 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-fc45e57b-9230-471a-94fd-856de7e2446e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:07.928031 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fc45e57b-9230-471a-94fd-856de7e2446e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:07.929164 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fc45e57b-9230-471a-94fd-856de7e2446e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:07.930399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fc45e57b-9230-471a-94fd-856de7e2446e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:07.933324 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fc45e57b-9230-471a-94fd-856de7e2446e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:07.948218 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fc45e57b-9230-471a-94fd-856de7e2446e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:07.949526 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fc45e57b-9230-471a-94fd-856de7e2446e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:08.304292 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-fc45e57b-9230-471a-94fd-856de7e2446e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:08.312566 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-fc45e57b-9230-471a-94fd-856de7e2446e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:08.314159 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-fc45e57b-9230-471a-94fd-856de7e2446e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:08.315294 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-fc45e57b-9230-471a-94fd-856de7e2446e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1724 microversion: 2.20 time: 0.415286 Aug 07 22:43:08.315847 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 272/565] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:07 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1724 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:09.338521 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-41202467-58d8-4fdc-b70f-c502871854a7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:09.343061 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-41202467-58d8-4fdc-b70f-c502871854a7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:09.346649 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:09.348756 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-41202467-58d8-4fdc-b70f-c502871854a7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:09.349525 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-41202467-58d8-4fdc-b70f-c502871854a7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:09.350201 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-41202467-58d8-4fdc-b70f-c502871854a7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:09.351796 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-41202467-58d8-4fdc-b70f-c502871854a7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:09.356913 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-41202467-58d8-4fdc-b70f-c502871854a7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:09.357509 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-41202467-58d8-4fdc-b70f-c502871854a7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:09.369687 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:09.711989 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-41202467-58d8-4fdc-b70f-c502871854a7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:09.720885 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-41202467-58d8-4fdc-b70f-c502871854a7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:09.729593 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-41202467-58d8-4fdc-b70f-c502871854a7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:09.730807 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-41202467-58d8-4fdc-b70f-c502871854a7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1724 microversion: 2.20 time: 0.397034 Aug 07 22:43:09.731813 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 294/566] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:09 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1724 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:10.754675 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-2cce06cd-0ae6-467b-934b-90171d8be820 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:10.756081 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-2cce06cd-0ae6-467b-934b-90171d8be820 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:10.759274 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:10.764512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2cce06cd-0ae6-467b-934b-90171d8be820 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:10.765196 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2cce06cd-0ae6-467b-934b-90171d8be820 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:10.765855 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2cce06cd-0ae6-467b-934b-90171d8be820 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:10.766782 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2cce06cd-0ae6-467b-934b-90171d8be820 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:10.767379 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2cce06cd-0ae6-467b-934b-90171d8be820 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:10.767952 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2cce06cd-0ae6-467b-934b-90171d8be820 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:10.953845 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-2cce06cd-0ae6-467b-934b-90171d8be820 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:10.962812 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-2cce06cd-0ae6-467b-934b-90171d8be820 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:10.965056 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-2cce06cd-0ae6-467b-934b-90171d8be820 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:10.972194 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-2cce06cd-0ae6-467b-934b-90171d8be820 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1724 microversion: 2.20 time: 0.216411 Aug 07 22:43:10.973644 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 273/567] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:10 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:11.739589 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a46c2f52-1fd9-4ccf-ad8a-8242e9d8da41 tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] Action: 'create', calling method: .version_select at 0x7fc09fd358b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1442244374"}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:43:11.992084 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-fcc8c29e-6ad4-447a-8ef9-dc874c3c7a2b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:11.992621 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-fcc8c29e-6ad4-447a-8ef9-dc874c3c7a2b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:11.998598 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fcc8c29e-6ad4-447a-8ef9-dc874c3c7a2b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:11.999273 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fcc8c29e-6ad4-447a-8ef9-dc874c3c7a2b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:12.000197 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fcc8c29e-6ad4-447a-8ef9-dc874c3c7a2b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:12.001062 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fcc8c29e-6ad4-447a-8ef9-dc874c3c7a2b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:12.001740 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fcc8c29e-6ad4-447a-8ef9-dc874c3c7a2b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:12.002329 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fcc8c29e-6ad4-447a-8ef9-dc874c3c7a2b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:12.188108 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-fcc8c29e-6ad4-447a-8ef9-dc874c3c7a2b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:12.208881 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-fcc8c29e-6ad4-447a-8ef9-dc874c3c7a2b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:12.211040 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-fcc8c29e-6ad4-447a-8ef9-dc874c3c7a2b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:12.212462 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-fcc8c29e-6ad4-447a-8ef9-dc874c3c7a2b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1724 microversion: 2.20 time: 0.225844 Aug 07 22:43:12.234036 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 274/568] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:11 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:43:12.375339 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a46c2f52-1fd9-4ccf-ad8a-8242e9d8da41 tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.793037 Aug 07 22:43:12.384587 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 295/569] 10.222.0.30 () {60 vars in 1155 bytes} [Sun Aug 7 22:43:11 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 803 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 07 22:43:12.397784 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-dcb14571-c395-4ec8-9f84-8595f507727a tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] Calling method '.version_select at 0x7fc0ac4d0a60>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:12.470405 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-dcb14571-c395-4ec8-9f84-8595f507727a tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/a072b32e-2034-4b23-b5a4-9415f17e36c2" status: 200 len: 345 microversion: 2.1 time: 0.076458 Aug 07 22:43:12.471217 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 275/570] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 22:43:12 2022] GET /compute/v2.1/os-volumes/a072b32e-2034-4b23-b5a4-9415f17e36c2 => generated 345 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:43:13.247033 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-4fca4c11-4e02-49ef-a427-3593c4dad51e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:13.252986 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-4fca4c11-4e02-49ef-a427-3593c4dad51e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:13.272136 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4fca4c11-4e02-49ef-a427-3593c4dad51e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:13.276215 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4fca4c11-4e02-49ef-a427-3593c4dad51e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:13.277660 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4fca4c11-4e02-49ef-a427-3593c4dad51e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:13.279307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4fca4c11-4e02-49ef-a427-3593c4dad51e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:13.280895 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4fca4c11-4e02-49ef-a427-3593c4dad51e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:13.281845 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4fca4c11-4e02-49ef-a427-3593c4dad51e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:13.486521 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ebc5bd4b-c922-4371-ac86-9f24a6291fb9 tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] Calling method '.version_select at 0x7fc0ac60f940>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:13.535388 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-4fca4c11-4e02-49ef-a427-3593c4dad51e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:13.551540 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-4fca4c11-4e02-49ef-a427-3593c4dad51e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:13.553522 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-4fca4c11-4e02-49ef-a427-3593c4dad51e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:13.555541 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-4fca4c11-4e02-49ef-a427-3593c4dad51e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1724 microversion: 2.20 time: 0.316473 Aug 07 22:43:13.556008 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-ebc5bd4b-c922-4371-ac86-9f24a6291fb9 tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/a072b32e-2034-4b23-b5a4-9415f17e36c2" status: 200 len: 346 microversion: 2.1 time: 0.074584 Aug 07 22:43:13.556980 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 276/571] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 22:43:13 2022] GET /compute/v2.1/os-volumes/a072b32e-2034-4b23-b5a4-9415f17e36c2 => generated 346 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:43:13.570031 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-68a2c5f0-c8d2-498a-8ce2-e6a1259f55a1 tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] Action: 'create', calling method: .version_select at 0x7fc0ac4b91f0>, body: {"snapshot": {"volume_id": "a072b32e-2034-4b23-b5a4-9415f17e36c2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1212623502"}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:43:13.572923 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 296/572] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:13 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1724 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:14.212981 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-68a2c5f0-c8d2-498a-8ce2-e6a1259f55a1 tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.646906 Aug 07 22:43:14.214516 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 277/573] 10.222.0.30 () {60 vars in 1162 bytes} [Sun Aug 7 22:43:13 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:43:14.224957 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-01c2d94b-7187-471f-98d8-54fcd34e80ea tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] Calling method '.version_select at 0x7fc09fc9fca0>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:14.271902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-01c2d94b-7187-471f-98d8-54fcd34e80ea tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/5698095e-ba46-4164-9142-f28206c81e1b" status: 200 len: 287 microversion: 2.1 time: 0.050797 Aug 07 22:43:14.279056 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 297/574] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Aug 7 22:43:14 2022] GET /compute/v2.1/os-snapshots/5698095e-ba46-4164-9142-f28206c81e1b => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:43:14.283965 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-03612021-b12d-4ed7-a2e0-6fefd5808519 tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] Calling method '.version_select at 0x7fc0ac7e9790>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:14.330501 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-03612021-b12d-4ed7-a2e0-6fefd5808519 tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.050553 Aug 07 22:43:14.334239 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 278/575] 10.222.0.30 () {58 vars in 1140 bytes} [Sun Aug 7 22:43:14 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:43:14.344203 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-cdd9fe01-d86d-4cc0-b4e9-990e9243310c tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] Calling method '.version_select at 0x7fc09fde78b0>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:14.379970 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-cdd9fe01-d86d-4cc0-b4e9-990e9243310c tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/5698095e-ba46-4164-9142-f28206c81e1b" status: 200 len: 287 microversion: 2.1 time: 0.040741 Aug 07 22:43:14.380555 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 298/576] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Aug 7 22:43:14 2022] GET /compute/v2.1/os-snapshots/5698095e-ba46-4164-9142-f28206c81e1b => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:43:14.581045 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-cdf047f9-a7fc-427d-a22f-58b368bd2ec5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:14.581846 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-cdf047f9-a7fc-427d-a22f-58b368bd2ec5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:14.589703 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cdf047f9-a7fc-427d-a22f-58b368bd2ec5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:14.590336 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cdf047f9-a7fc-427d-a22f-58b368bd2ec5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:14.590848 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cdf047f9-a7fc-427d-a22f-58b368bd2ec5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:14.591612 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cdf047f9-a7fc-427d-a22f-58b368bd2ec5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:14.592156 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cdf047f9-a7fc-427d-a22f-58b368bd2ec5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:14.592662 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cdf047f9-a7fc-427d-a22f-58b368bd2ec5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:14.816721 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-cdf047f9-a7fc-427d-a22f-58b368bd2ec5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:14.827601 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-cdf047f9-a7fc-427d-a22f-58b368bd2ec5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:14.829187 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-cdf047f9-a7fc-427d-a22f-58b368bd2ec5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:14.830361 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-cdf047f9-a7fc-427d-a22f-58b368bd2ec5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1724 microversion: 2.20 time: 0.253709 Aug 07 22:43:14.830915 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 279/577] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:14 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:15.393434 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a4c6eaa8-3d93-4e1c-8b88-a00ad3c3bf9b tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] Calling method '.version_select at 0x7fc09fcd1c10>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:15.425963 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a4c6eaa8-3d93-4e1c-8b88-a00ad3c3bf9b tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/5698095e-ba46-4164-9142-f28206c81e1b" status: 200 len: 287 microversion: 2.1 time: 0.036728 Aug 07 22:43:15.426603 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 299/578] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Aug 7 22:43:15 2022] GET /compute/v2.1/os-snapshots/5698095e-ba46-4164-9142-f28206c81e1b => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:43:15.855080 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-93aae7f2-7d4c-41a9-a691-a0cfd30c70dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:15.855896 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-93aae7f2-7d4c-41a9-a691-a0cfd30c70dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:15.864999 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-93aae7f2-7d4c-41a9-a691-a0cfd30c70dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:15.865842 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-93aae7f2-7d4c-41a9-a691-a0cfd30c70dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:15.866966 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-93aae7f2-7d4c-41a9-a691-a0cfd30c70dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:15.867842 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-93aae7f2-7d4c-41a9-a691-a0cfd30c70dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:15.868471 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-93aae7f2-7d4c-41a9-a691-a0cfd30c70dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:15.869049 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-93aae7f2-7d4c-41a9-a691-a0cfd30c70dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:16.020327 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-93aae7f2-7d4c-41a9-a691-a0cfd30c70dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:16.029850 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-93aae7f2-7d4c-41a9-a691-a0cfd30c70dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:16.031383 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-93aae7f2-7d4c-41a9-a691-a0cfd30c70dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:16.032867 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-93aae7f2-7d4c-41a9-a691-a0cfd30c70dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1724 microversion: 2.20 time: 0.182051 Aug 07 22:43:16.033815 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 280/579] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:15 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:16.438842 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-6c2f76d9-841b-49b3-8d81-230f29bd1565 tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] Calling method '.version_select at 0x7fc09fde78b0>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:16.473055 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-6c2f76d9-841b-49b3-8d81-230f29bd1565 tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/5698095e-ba46-4164-9142-f28206c81e1b" status: 200 len: 287 microversion: 2.1 time: 0.038133 Aug 07 22:43:16.474105 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 300/580] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Aug 7 22:43:16 2022] GET /compute/v2.1/os-snapshots/5698095e-ba46-4164-9142-f28206c81e1b => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:43:17.057302 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-580cd9c6-e144-4818-a954-10a641a9f331 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:17.057911 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-580cd9c6-e144-4818-a954-10a641a9f331 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:17.064891 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-580cd9c6-e144-4818-a954-10a641a9f331 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:17.065398 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-580cd9c6-e144-4818-a954-10a641a9f331 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:17.065875 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-580cd9c6-e144-4818-a954-10a641a9f331 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:17.066604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-580cd9c6-e144-4818-a954-10a641a9f331 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:17.067058 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-580cd9c6-e144-4818-a954-10a641a9f331 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:17.067512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-580cd9c6-e144-4818-a954-10a641a9f331 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:17.217785 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-580cd9c6-e144-4818-a954-10a641a9f331 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:17.226482 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-580cd9c6-e144-4818-a954-10a641a9f331 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:17.228151 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-580cd9c6-e144-4818-a954-10a641a9f331 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:17.229431 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-580cd9c6-e144-4818-a954-10a641a9f331 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1724 microversion: 2.20 time: 0.176445 Aug 07 22:43:17.229992 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 281/581] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:17 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:17.486468 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f8996cd4-c2eb-4d04-8a9b-b2c4743067cd tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] Calling method '.version_select at 0x7fc09fc9f820>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:17.517458 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f8996cd4-c2eb-4d04-8a9b-b2c4743067cd tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/5698095e-ba46-4164-9142-f28206c81e1b" status: 200 len: 288 microversion: 2.1 time: 0.035209 Aug 07 22:43:17.518032 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 301/582] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Aug 7 22:43:17 2022] GET /compute/v2.1/os-snapshots/5698095e-ba46-4164-9142-f28206c81e1b => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:43:17.529110 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-35ce8398-98fd-4255-b988-43e5a885b1dc tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] Calling method '.version_select at 0x7fc0ac4ed5e0>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:17.659315 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-35ce8398-98fd-4255-b988-43e5a885b1dc tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/5698095e-ba46-4164-9142-f28206c81e1b" status: 202 len: 0 microversion: 2.1 time: 0.133977 Aug 07 22:43:17.659893 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 282/583] 10.222.0.30 () {58 vars in 1254 bytes} [Sun Aug 7 22:43:17 2022] DELETE /compute/v2.1/os-snapshots/5698095e-ba46-4164-9142-f28206c81e1b => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:43:17.669765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-7b018e8f-bb43-425a-a956-b528538f481a tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] Calling method '.version_select at 0x7fc09fe7b310>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:17.706417 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-7b018e8f-bb43-425a-a956-b528538f481a tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/5698095e-ba46-4164-9142-f28206c81e1b" status: 200 len: 287 microversion: 2.1 time: 0.041883 Aug 07 22:43:17.706994 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 302/584] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Aug 7 22:43:17 2022] GET /compute/v2.1/os-snapshots/5698095e-ba46-4164-9142-f28206c81e1b => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:43:18.255025 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-b3e0c6a4-b222-493a-8924-6945cd054456 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:18.255564 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-b3e0c6a4-b222-493a-8924-6945cd054456 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:18.263689 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b3e0c6a4-b222-493a-8924-6945cd054456 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:18.263689 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b3e0c6a4-b222-493a-8924-6945cd054456 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:18.264974 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b3e0c6a4-b222-493a-8924-6945cd054456 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:18.264974 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b3e0c6a4-b222-493a-8924-6945cd054456 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:18.265457 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b3e0c6a4-b222-493a-8924-6945cd054456 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:18.265716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b3e0c6a4-b222-493a-8924-6945cd054456 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:18.428131 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-b3e0c6a4-b222-493a-8924-6945cd054456 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:18.437857 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-b3e0c6a4-b222-493a-8924-6945cd054456 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:18.440244 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-b3e0c6a4-b222-493a-8924-6945cd054456 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:18.441243 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-b3e0c6a4-b222-493a-8924-6945cd054456 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1724 microversion: 2.20 time: 0.190625 Aug 07 22:43:18.456823 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 283/585] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:18 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:18.719068 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-4007ebd4-7749-4fe0-a0b0-afad03075683 tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] Calling method '.version_select at 0x7fc09fc9ff70>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:18.745352 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-4007ebd4-7749-4fe0-a0b0-afad03075683 tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] HTTP exception thrown: Snapshot 5698095e-ba46-4164-9142-f28206c81e1b could not be found. Aug 07 22:43:18.747657 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-4007ebd4-7749-4fe0-a0b0-afad03075683 tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] Request method failure captured: Aug 07 22:43:18.747657 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: GET /compute/v2.1/os-snapshots/5698095e-ba46-4164-9142-f28206c81e1b HTTP/1.1 Aug 07 22:43:18.747657 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:43:18.747657 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:43:18.747657 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:43:18.747657 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:43:18.747657 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:43:18.747657 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:43:18.747657 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:43:18.747657 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:43:18.747657 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8D__9qyuOHlM7ewAAnjgDuwijTbn3wY4Jeca7uyWg6LlYT4RcNY998I2Mp1aiwM4zhoP1jcU9C4ikEBc0QWkriwcR-YyIZNGKPDsox3vcOv2KTFftLZ-sUpC0-Fp7gh4__aypLn0-rJQ2d3RPIHi9Xl52dzjrIMjmbgfN7wxWOIaLAA Aug 07 22:43:18.747657 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:43:18.747657 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:43:18.747657 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:43:18.747657 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:43:18.747657 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:43:18.747657 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:43:18.747657 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 8bec6d4d3a7343219d5cb8708fe41182 Aug 07 22:43:18.747657 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-561413184 Aug 07 22:43:18.747657 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:43:18.747657 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:43:18.749182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8bec6d4d3a7343219d5cb8708fe41182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8bec6d4d3a7343219d5cb8708fe41182"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8bec6d4d3a7343219d5cb8708fe41182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8bec6d4d3a7343219d5cb8708fe41182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:43:18.749182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-VolumesSnapshotsTestJSON-561413184 Aug 07 22:43:18.749182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 8bec6d4d3a7343219d5cb8708fe41182 Aug 07 22:43:18.749182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-561413184 Aug 07 22:43:18.749182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-VolumesSnapshotsTestJSON-561413184-project Aug 07 22:43:18.749182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:43:18.749182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:43:18.749182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: a9c9746b11594619bb056613ea2091f4 Aug 07 22:43:18.749182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-VolumesSnapshotsTestJSON-561413184-project Aug 07 22:43:18.749182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: Aug 07 22:43:18.749182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Snapshot 5698095e-ba46-4164-9142-f28206c81e1b could not be found. Aug 07 22:43:18.749182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': '5698095e-ba46-4164-9142-f28206c81e1b'} Aug 07 22:43:18.749182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:43:18.750080 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:43:18.750080 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 07 22:43:18.750080 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 07 22:43:18.750080 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 07 22:43:18.750080 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 07 22:43:18.750080 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 07 22:43:18.750080 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 07 22:43:18.750080 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 22:43:18.750080 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 22:43:18.750080 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 22:43:18.750080 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 22:43:18.750080 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 22:43:18.750080 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 22:43:18.750080 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 22:43:18.750080 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 22:43:18.750080 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5698095e-ba46-4164-9142-f28206c81e1b could not be found. (HTTP 404) (Request-ID: req-b7118872-6806-4afa-9f09-cb27f0e43088) Aug 07 22:43:18.750080 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:43:18.750080 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:43:18.751617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:43:18.751617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:43:18.751617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 07 22:43:18.751617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 07 22:43:18.751617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 22:43:18.751617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 22:43:18.751617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 07 22:43:18.751617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 07 22:43:18.751617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 22:43:18.751617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 22:43:18.751617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 07 22:43:18.751617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 07 22:43:18.751617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 07 22:43:18.751617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 07 22:43:18.751617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 07 22:43:18.751617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 07 22:43:18.751617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 22:43:18.751617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 22:43:18.751617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 22:43:18.753765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 22:43:18.753765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 22:43:18.753765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 22:43:18.753765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 22:43:18.753765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 22:43:18.753765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5698095e-ba46-4164-9142-f28206c81e1b could not be found. Aug 07 22:43:18.753765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:43:18.753765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:43:18.753765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:43:18.753765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:43:18.753765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:43:18.753765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:43:18.753765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:43:18.753765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:43:18.753765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 22:43:18.753765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 22:43:18.753765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:43:18.753765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:43:18.753765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 07 22:43:18.753765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:43:18.756396 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5698095e-ba46-4164-9142-f28206c81e1b could not be found. Aug 07 22:43:18.756396 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:43:18.756396 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:43:18.756396 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:43:18.756396 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:43:18.756396 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:43:18.756396 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:43:18.756396 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:43:18.756396 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:43:18.756396 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5698095e-ba46-4164-9142-f28206c81e1b could not be found. Aug 07 22:43:18.756396 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:43:18.756396 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-4007ebd4-7749-4fe0-a0b0-afad03075683 tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] Returning 404 to user: Snapshot 5698095e-ba46-4164-9142-f28206c81e1b could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:43:18.756396 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-4007ebd4-7749-4fe0-a0b0-afad03075683 tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/5698095e-ba46-4164-9142-f28206c81e1b" status: 404 len: 111 microversion: 2.1 time: 0.034307 Aug 07 22:43:18.756396 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 303/586] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Aug 7 22:43:18 2022] GET /compute/v2.1/os-snapshots/5698095e-ba46-4164-9142-f28206c81e1b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:43:18.759032 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-af658259-2269-416e-a45d-453562a6586b tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] Calling method '.version_select at 0x7fc0ac4edc10>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:18.983262 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-af658259-2269-416e-a45d-453562a6586b tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/a072b32e-2034-4b23-b5a4-9415f17e36c2" status: 202 len: 0 microversion: 2.1 time: 0.229331 Aug 07 22:43:18.987631 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 284/587] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Aug 7 22:43:18 2022] DELETE /compute/v2.1/os-volumes/a072b32e-2034-4b23-b5a4-9415f17e36c2 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:43:18.995482 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-22e32f42-243b-45bd-a370-a6d67fa6a09b tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] Calling method '.version_select at 0x7fc09fde7160>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:19.051904 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-22e32f42-243b-45bd-a370-a6d67fa6a09b tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/a072b32e-2034-4b23-b5a4-9415f17e36c2" status: 200 len: 345 microversion: 2.1 time: 0.063029 Aug 07 22:43:19.052809 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 304/588] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 22:43:18 2022] GET /compute/v2.1/os-volumes/a072b32e-2034-4b23-b5a4-9415f17e36c2 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:43:19.465391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-e347079d-ed2f-4538-bc92-6471de565edb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:19.466194 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-e347079d-ed2f-4538-bc92-6471de565edb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:19.473072 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e347079d-ed2f-4538-bc92-6471de565edb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:19.473678 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e347079d-ed2f-4538-bc92-6471de565edb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:19.474339 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e347079d-ed2f-4538-bc92-6471de565edb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:19.475128 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e347079d-ed2f-4538-bc92-6471de565edb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:19.478241 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e347079d-ed2f-4538-bc92-6471de565edb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:19.478804 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e347079d-ed2f-4538-bc92-6471de565edb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:19.645434 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-e347079d-ed2f-4538-bc92-6471de565edb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:19.655058 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-e347079d-ed2f-4538-bc92-6471de565edb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:19.656788 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-e347079d-ed2f-4538-bc92-6471de565edb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:19.657940 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-e347079d-ed2f-4538-bc92-6471de565edb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1745 microversion: 2.20 time: 0.197730 Aug 07 22:43:19.658502 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 285/589] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:19 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1745 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:20.067179 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-fdd9d586-e01a-40ac-bc5d-599b14e3555a tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] Calling method '.version_select at 0x7fc09fcd1940>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:20.098461 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-fdd9d586-e01a-40ac-bc5d-599b14e3555a tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] HTTP exception thrown: Volume a072b32e-2034-4b23-b5a4-9415f17e36c2 could not be found. Aug 07 22:43:20.100687 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-fdd9d586-e01a-40ac-bc5d-599b14e3555a tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] Request method failure captured: Aug 07 22:43:20.100687 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: GET /compute/v2.1/os-volumes/a072b32e-2034-4b23-b5a4-9415f17e36c2 HTTP/1.1 Aug 07 22:43:20.100687 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:43:20.100687 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:43:20.100687 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:43:20.100687 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:43:20.100687 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:43:20.100687 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:43:20.100687 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:43:20.100687 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:43:20.100687 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8D__9qyuOHlM7ewAAnjgDuwijTbn3wY4Jeca7uyWg6LlYT4RcNY998I2Mp1aiwM4zhoP1jcU9C4ikEBc0QWkriwcR-YyIZNGKPDsox3vcOv2KTFftLZ-sUpC0-Fp7gh4__aypLn0-rJQ2d3RPIHi9Xl52dzjrIMjmbgfN7wxWOIaLAA Aug 07 22:43:20.100687 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:43:20.100687 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:43:20.100687 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:43:20.100687 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:43:20.100687 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:43:20.100687 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:43:20.100687 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 8bec6d4d3a7343219d5cb8708fe41182 Aug 07 22:43:20.100687 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-561413184 Aug 07 22:43:20.100687 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:43:20.100687 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:43:20.102697 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8bec6d4d3a7343219d5cb8708fe41182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8bec6d4d3a7343219d5cb8708fe41182"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8bec6d4d3a7343219d5cb8708fe41182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8bec6d4d3a7343219d5cb8708fe41182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:43:20.102697 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-VolumesSnapshotsTestJSON-561413184 Aug 07 22:43:20.102697 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 8bec6d4d3a7343219d5cb8708fe41182 Aug 07 22:43:20.102697 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-561413184 Aug 07 22:43:20.102697 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-VolumesSnapshotsTestJSON-561413184-project Aug 07 22:43:20.102697 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:43:20.102697 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:43:20.102697 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: a9c9746b11594619bb056613ea2091f4 Aug 07 22:43:20.102697 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-VolumesSnapshotsTestJSON-561413184-project Aug 07 22:43:20.102697 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: Aug 07 22:43:20.102697 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Volume a072b32e-2034-4b23-b5a4-9415f17e36c2 could not be found. Aug 07 22:43:20.102697 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': 'a072b32e-2034-4b23-b5a4-9415f17e36c2'} Aug 07 22:43:20.102697 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:43:20.103735 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:43:20.103735 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 22:43:20.103735 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 22:43:20.103735 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 22:43:20.103735 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 22:43:20.103735 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 22:43:20.103735 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 22:43:20.103735 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 22:43:20.103735 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 22:43:20.103735 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 22:43:20.103735 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 22:43:20.103735 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 22:43:20.103735 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 22:43:20.103735 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 22:43:20.103735 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 22:43:20.103735 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a072b32e-2034-4b23-b5a4-9415f17e36c2 could not be found. (HTTP 404) (Request-ID: req-50e28691-fef9-4925-ba05-115f190eb8ee) Aug 07 22:43:20.103735 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:43:20.103735 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:43:20.103735 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:43:20.105106 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:43:20.105106 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 07 22:43:20.105106 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 07 22:43:20.105106 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 22:43:20.105106 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 22:43:20.105106 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 22:43:20.105106 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 22:43:20.105106 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 22:43:20.105106 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 22:43:20.105106 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 22:43:20.105106 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 22:43:20.105106 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 22:43:20.105106 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 22:43:20.105106 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 22:43:20.105106 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 22:43:20.105106 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 22:43:20.105106 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 22:43:20.105106 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 22:43:20.105106 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 22:43:20.107109 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 22:43:20.107109 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 22:43:20.107109 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 22:43:20.107109 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 22:43:20.107109 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a072b32e-2034-4b23-b5a4-9415f17e36c2 could not be found. Aug 07 22:43:20.107109 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:43:20.107109 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:43:20.107109 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:43:20.107109 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:43:20.107109 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:43:20.107109 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:43:20.107109 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:43:20.107109 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:43:20.107109 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 22:43:20.107109 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 22:43:20.107109 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:43:20.107109 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:43:20.107109 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 07 22:43:20.107109 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:43:20.115406 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a072b32e-2034-4b23-b5a4-9415f17e36c2 could not be found. Aug 07 22:43:20.115406 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:43:20.115406 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:43:20.115406 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:43:20.115406 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:43:20.115406 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:43:20.115406 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:43:20.115406 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:43:20.115406 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:43:20.115406 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a072b32e-2034-4b23-b5a4-9415f17e36c2 could not be found. Aug 07 22:43:20.115406 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:43:20.115406 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-fdd9d586-e01a-40ac-bc5d-599b14e3555a tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] Returning 404 to user: Volume a072b32e-2034-4b23-b5a4-9415f17e36c2 could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:43:20.115406 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-fdd9d586-e01a-40ac-bc5d-599b14e3555a tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/a072b32e-2034-4b23-b5a4-9415f17e36c2" status: 404 len: 109 microversion: 2.1 time: 0.039773 Aug 07 22:43:20.115406 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 305/590] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 22:43:20 2022] GET /compute/v2.1/os-volumes/a072b32e-2034-4b23-b5a4-9415f17e36c2 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:43:20.123497 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7fd9eceb-9baa-425f-a7ca-860f99e1bec3 tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] Calling method '.version_select at 0x7fc0ac4edb80>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:20.193991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.wsgi [None req-7fd9eceb-9baa-425f-a7ca-860f99e1bec3 tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] HTTP exception thrown: Volume a072b32e-2034-4b23-b5a4-9415f17e36c2 could not be found. Aug 07 22:43:20.193991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7fd9eceb-9baa-425f-a7ca-860f99e1bec3 tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] Request method failure captured: Aug 07 22:43:20.193991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: request: DELETE /compute/v2.1/os-volumes/a072b32e-2034-4b23-b5a4-9415f17e36c2 HTTP/1.1 Aug 07 22:43:20.193991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept: application/json Aug 07 22:43:20.193991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept-Encoding: identity Aug 07 22:43:20.193991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Connection: close Aug 07 22:43:20.193991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Length: 0 Aug 07 22:43:20.193991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Type: application/json Aug 07 22:43:20.193991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Host: 10.222.0.30 Aug 07 22:43:20.193991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Openstack-System-Scope: None Aug 07 22:43:20.193991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: User-Agent: python-urllib3/1.26.11 Aug 07 22:43:20.193991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Auth-Token: gAAAAABi8D__9qyuOHlM7ewAAnjgDuwijTbn3wY4Jeca7uyWg6LlYT4RcNY998I2Mp1aiwM4zhoP1jcU9C4ikEBc0QWkriwcR-YyIZNGKPDsox3vcOv2KTFftLZ-sUpC0-Fp7gh4__aypLn0-rJQ2d3RPIHi9Xl52dzjrIMjmbgfN7wxWOIaLAA Aug 07 22:43:20.193991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Id: None Aug 07 22:43:20.193991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Name: None Aug 07 22:43:20.193991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Identity-Status: Confirmed Aug 07 22:43:20.193991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Is-Admin-Project: True Aug 07 22:43:20.193991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Id: default Aug 07 22:43:20.193991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Name: Default Aug 07 22:43:20.193991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Id: 8bec6d4d3a7343219d5cb8708fe41182 Aug 07 22:43:20.193991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-561413184 Aug 07 22:43:20.193991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Role: reader,member Aug 07 22:43:20.193991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Roles: reader,member Aug 07 22:43:20.197248 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8bec6d4d3a7343219d5cb8708fe41182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8bec6d4d3a7343219d5cb8708fe41182"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8bec6d4d3a7343219d5cb8708fe41182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8bec6d4d3a7343219d5cb8708fe41182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:43:20.197248 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant: tempest-VolumesSnapshotsTestJSON-561413184 Aug 07 22:43:20.197248 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Id: 8bec6d4d3a7343219d5cb8708fe41182 Aug 07 22:43:20.197248 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-561413184 Aug 07 22:43:20.197248 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User: tempest-VolumesSnapshotsTestJSON-561413184-project Aug 07 22:43:20.197248 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Id: default Aug 07 22:43:20.197248 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Name: Default Aug 07 22:43:20.197248 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Id: a9c9746b11594619bb056613ea2091f4 Aug 07 22:43:20.197248 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Name: tempest-VolumesSnapshotsTestJSON-561413184-project Aug 07 22:43:20.197248 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: method: Aug 07 22:43:20.197248 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: exception: Volume a072b32e-2034-4b23-b5a4-9415f17e36c2 could not be found. Aug 07 22:43:20.197248 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: action_args: {'id': 'a072b32e-2034-4b23-b5a4-9415f17e36c2'} Aug 07 22:43:20.197248 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:43:20.198115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:43:20.198115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 22:43:20.198115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 22:43:20.198115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 22:43:20.198115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 22:43:20.198115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 22:43:20.198115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 22:43:20.198115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 22:43:20.198115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 22:43:20.198115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 22:43:20.198115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 22:43:20.198115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 22:43:20.198115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 22:43:20.198115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 22:43:20.198115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 22:43:20.198115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a072b32e-2034-4b23-b5a4-9415f17e36c2 could not be found. (HTTP 404) (Request-ID: req-c22a1f3a-e3d7-40fe-8c29-09932fdee456) Aug 07 22:43:20.198115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:43:20.198115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:43:20.198115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:43:20.199597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:43:20.199597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 07 22:43:20.199597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 07 22:43:20.199597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 22:43:20.199597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 22:43:20.199597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 22:43:20.199597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 22:43:20.199597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 22:43:20.199597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 22:43:20.199597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 22:43:20.199597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 22:43:20.199597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 22:43:20.199597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 22:43:20.199597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 22:43:20.199597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 22:43:20.199597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 22:43:20.199597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 22:43:20.199597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 22:43:20.199597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 22:43:20.201175 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 22:43:20.201175 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 22:43:20.201175 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 22:43:20.201175 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 22:43:20.201175 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a072b32e-2034-4b23-b5a4-9415f17e36c2 could not be found. Aug 07 22:43:20.201175 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:43:20.201175 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:43:20.201175 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:43:20.201175 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:43:20.201175 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:43:20.201175 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:43:20.201175 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:43:20.201175 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:43:20.201175 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 22:43:20.201175 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 22:43:20.201175 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:43:20.201175 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:43:20.201175 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 07 22:43:20.201175 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:43:20.202392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a072b32e-2034-4b23-b5a4-9415f17e36c2 could not be found. Aug 07 22:43:20.202392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:43:20.202392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:43:20.202392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:43:20.202392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:43:20.202392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:43:20.202392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:43:20.202392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:43:20.202392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:43:20.202392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a072b32e-2034-4b23-b5a4-9415f17e36c2 could not be found. Aug 07 22:43:20.202392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:43:20.202392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7fd9eceb-9baa-425f-a7ca-860f99e1bec3 tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] Returning 404 to user: Volume a072b32e-2034-4b23-b5a4-9415f17e36c2 could not be found. {{(pid=129965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:43:20.202392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-7fd9eceb-9baa-425f-a7ca-860f99e1bec3 tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/a072b32e-2034-4b23-b5a4-9415f17e36c2" status: 404 len: 109 microversion: 2.1 time: 0.054641 Aug 07 22:43:20.202392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 286/591] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Aug 7 22:43:20 2022] DELETE /compute/v2.1/os-volumes/a072b32e-2034-4b23-b5a4-9415f17e36c2 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:43:20.208983 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-2a1397a9-19f8-4564-8a5d-c2086030b620 tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] Calling method '.version_select at 0x7fc09fd8f670>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:20.239325 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-2a1397a9-19f8-4564-8a5d-c2086030b620 tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] HTTP exception thrown: Volume a072b32e-2034-4b23-b5a4-9415f17e36c2 could not be found. Aug 07 22:43:20.241424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-2a1397a9-19f8-4564-8a5d-c2086030b620 tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] Request method failure captured: Aug 07 22:43:20.241424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: GET /compute/v2.1/os-volumes/a072b32e-2034-4b23-b5a4-9415f17e36c2 HTTP/1.1 Aug 07 22:43:20.241424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:43:20.241424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:43:20.241424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:43:20.241424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:43:20.241424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:43:20.241424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:43:20.241424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:43:20.241424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:43:20.241424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8D__9qyuOHlM7ewAAnjgDuwijTbn3wY4Jeca7uyWg6LlYT4RcNY998I2Mp1aiwM4zhoP1jcU9C4ikEBc0QWkriwcR-YyIZNGKPDsox3vcOv2KTFftLZ-sUpC0-Fp7gh4__aypLn0-rJQ2d3RPIHi9Xl52dzjrIMjmbgfN7wxWOIaLAA Aug 07 22:43:20.241424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:43:20.241424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:43:20.241424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:43:20.241424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:43:20.241424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:43:20.241424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:43:20.241424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 8bec6d4d3a7343219d5cb8708fe41182 Aug 07 22:43:20.241424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-561413184 Aug 07 22:43:20.241424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:43:20.241424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:43:20.243728 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8bec6d4d3a7343219d5cb8708fe41182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8bec6d4d3a7343219d5cb8708fe41182"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8bec6d4d3a7343219d5cb8708fe41182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8bec6d4d3a7343219d5cb8708fe41182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:43:20.243728 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-VolumesSnapshotsTestJSON-561413184 Aug 07 22:43:20.243728 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 8bec6d4d3a7343219d5cb8708fe41182 Aug 07 22:43:20.243728 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-561413184 Aug 07 22:43:20.243728 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-VolumesSnapshotsTestJSON-561413184-project Aug 07 22:43:20.243728 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:43:20.243728 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:43:20.243728 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: a9c9746b11594619bb056613ea2091f4 Aug 07 22:43:20.243728 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-VolumesSnapshotsTestJSON-561413184-project Aug 07 22:43:20.243728 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: Aug 07 22:43:20.243728 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Volume a072b32e-2034-4b23-b5a4-9415f17e36c2 could not be found. Aug 07 22:43:20.243728 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': 'a072b32e-2034-4b23-b5a4-9415f17e36c2'} Aug 07 22:43:20.243728 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:43:20.248770 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:43:20.248770 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 22:43:20.248770 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 22:43:20.248770 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 22:43:20.248770 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 22:43:20.248770 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 22:43:20.248770 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 22:43:20.248770 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 22:43:20.248770 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 22:43:20.248770 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 22:43:20.248770 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 22:43:20.248770 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 22:43:20.248770 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 22:43:20.248770 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 22:43:20.248770 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 22:43:20.248770 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a072b32e-2034-4b23-b5a4-9415f17e36c2 could not be found. (HTTP 404) (Request-ID: req-1ec7578f-639c-430b-832e-c100dd3b62aa) Aug 07 22:43:20.248770 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:43:20.248770 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:43:20.248770 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:43:20.250347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:43:20.250347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 07 22:43:20.250347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 07 22:43:20.250347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 22:43:20.250347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 22:43:20.250347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 22:43:20.250347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 22:43:20.250347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 22:43:20.250347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 22:43:20.250347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 22:43:20.250347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 22:43:20.250347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 22:43:20.250347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 22:43:20.250347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 22:43:20.250347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 22:43:20.250347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 22:43:20.250347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 22:43:20.250347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 22:43:20.250347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 22:43:20.252425 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 22:43:20.252425 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 22:43:20.252425 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 22:43:20.252425 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 22:43:20.252425 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a072b32e-2034-4b23-b5a4-9415f17e36c2 could not be found. Aug 07 22:43:20.252425 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:43:20.252425 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:43:20.252425 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:43:20.252425 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:43:20.252425 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:43:20.252425 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:43:20.252425 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:43:20.252425 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:43:20.252425 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 22:43:20.252425 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 22:43:20.252425 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:43:20.252425 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:43:20.252425 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 07 22:43:20.252425 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:43:20.253655 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a072b32e-2034-4b23-b5a4-9415f17e36c2 could not be found. Aug 07 22:43:20.253655 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:43:20.253655 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:43:20.253655 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:43:20.253655 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:43:20.253655 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:43:20.253655 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:43:20.253655 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:43:20.253655 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:43:20.253655 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a072b32e-2034-4b23-b5a4-9415f17e36c2 could not be found. Aug 07 22:43:20.253655 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:43:20.253655 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-2a1397a9-19f8-4564-8a5d-c2086030b620 tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] Returning 404 to user: Volume a072b32e-2034-4b23-b5a4-9415f17e36c2 could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:43:20.253655 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-2a1397a9-19f8-4564-8a5d-c2086030b620 tempest-VolumesSnapshotsTestJSON-561413184 tempest-VolumesSnapshotsTestJSON-561413184-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/a072b32e-2034-4b23-b5a4-9415f17e36c2" status: 404 len: 109 microversion: 2.1 time: 0.038863 Aug 07 22:43:20.253655 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 306/592] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 22:43:20 2022] GET /compute/v2.1/os-volumes/a072b32e-2034-4b23-b5a4-9415f17e36c2 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:43:20.685167 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-8fa0776d-c3f8-482e-aa96-abd2e58cee1e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:20.687140 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-8fa0776d-c3f8-482e-aa96-abd2e58cee1e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:20.695772 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8fa0776d-c3f8-482e-aa96-abd2e58cee1e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:20.696302 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8fa0776d-c3f8-482e-aa96-abd2e58cee1e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:20.697060 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8fa0776d-c3f8-482e-aa96-abd2e58cee1e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:20.699211 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8fa0776d-c3f8-482e-aa96-abd2e58cee1e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:20.699896 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8fa0776d-c3f8-482e-aa96-abd2e58cee1e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:20.700859 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8fa0776d-c3f8-482e-aa96-abd2e58cee1e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:20.917757 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8fa0776d-c3f8-482e-aa96-abd2e58cee1e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:20.930919 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8fa0776d-c3f8-482e-aa96-abd2e58cee1e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:20.933536 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8fa0776d-c3f8-482e-aa96-abd2e58cee1e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:20.935949 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-8fa0776d-c3f8-482e-aa96-abd2e58cee1e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1740 microversion: 2.20 time: 0.255641 Aug 07 22:43:20.937128 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 287/593] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:20 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1740 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:21.788806 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a2f54781-6dc8-46ff-b3f2-3345a46ec7e0 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Action: 'create', calling method: .version_select at 0x7fc09fd35040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1385561946", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIwiRuxWVbVcfTvg8sytP/Vsc0dhok/X5V3CTfu6L3jGkYMC7Xeg25OW0JZ98EGbp8+EYp3Coif+rLFduWxPFXZ2l4i97De8B0X0xvFgJymyduKd0/lxXuNoTfY0GKB8Q=="}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:43:21.806138 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-a2f54781-6dc8-46ff-b3f2-3345a46ec7e0 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Getting quotas for project bcc9a378e7ba4206baaa7bcc683606ca. Resources: {'key_pairs'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:43:21.811807 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-a2f54781-6dc8-46ff-b3f2-3345a46ec7e0 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Getting quotas for user acf297d1f1f244dd997992583189c127 and project bcc9a378e7ba4206baaa7bcc683606ca. Resources: {'key_pairs'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:43:21.922592 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a2f54781-6dc8-46ff-b3f2-3345a46ec7e0 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.141058 Aug 07 22:43:21.923533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 307/594] 10.222.0.30 () {60 vars in 1159 bytes} [Sun Aug 7 22:43:21 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:43:21.960416 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-92ec5a73-6554-4de4-bb0e-df00e0e576af tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:21.962191 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-92ec5a73-6554-4de4-bb0e-df00e0e576af tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:21.970994 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-92ec5a73-6554-4de4-bb0e-df00e0e576af tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:21.971558 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-92ec5a73-6554-4de4-bb0e-df00e0e576af tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:21.980407 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-92ec5a73-6554-4de4-bb0e-df00e0e576af tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:21.981651 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-92ec5a73-6554-4de4-bb0e-df00e0e576af tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:21.982342 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-92ec5a73-6554-4de4-bb0e-df00e0e576af tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:21.982788 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-92ec5a73-6554-4de4-bb0e-df00e0e576af tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:22.144346 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b7c50d26-af78-4597-85d5-294217f2b9d3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1133537145", "imageRef": "f6d82122-aaf8-4ae2-8368-9740515f5b89", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1385561946", "networks": [{"uuid": "9f74fe23-4b28-44d3-b565-87222cc4b31a"}]}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:43:22.218682 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.network.neutron [None req-b7c50d26-af78-4597-85d5-294217f2b9d3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] validate_networks() for [('9f74fe23-4b28-44d3-b565-87222cc4b31a', None, None, None, None, None)] {{(pid=129964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 22:43:22.583100 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-92ec5a73-6554-4de4-bb0e-df00e0e576af tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:22.591534 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-92ec5a73-6554-4de4-bb0e-df00e0e576af tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:22.593049 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-92ec5a73-6554-4de4-bb0e-df00e0e576af tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:22.594187 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-92ec5a73-6554-4de4-bb0e-df00e0e576af tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1740 microversion: 2.20 time: 0.639355 Aug 07 22:43:22.603591 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 288/595] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:21 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1740 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:22.826816 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-32927b35-2371-40f7-8982-2995555c2a0b req-84ca63c9-a612-46d0-989f-f5a00c35d9b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cef2464-0337-4fbd-a727-a24160f14f99", "name": "network-vif-plugged", "status": "completed", "tag": "28f8e101-7a4a-4833-b344-83657618e970"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:43:22.844599 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-32927b35-2371-40f7-8982-2995555c2a0b req-84ca63c9-a612-46d0-989f-f5a00c35d9b6 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:22.845347 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-32927b35-2371-40f7-8982-2995555c2a0b req-84ca63c9-a612-46d0-989f-f5a00c35d9b6 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:22.846358 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-32927b35-2371-40f7-8982-2995555c2a0b req-84ca63c9-a612-46d0-989f-f5a00c35d9b6 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:22.860090 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-32927b35-2371-40f7-8982-2995555c2a0b req-84ca63c9-a612-46d0-989f-f5a00c35d9b6 service nova] Creating event network-vif-plugged:28f8e101-7a4a-4833-b344-83657618e970 for instance 9cef2464-0337-4fbd-a727-a24160f14f99 on hv-cinder-85032 Aug 07 22:43:22.868997 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-32927b35-2371-40f7-8982-2995555c2a0b req-84ca63c9-a612-46d0-989f-f5a00c35d9b6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.264142 Aug 07 22:43:22.874590 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 289/596] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:43:23.061852 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-b7c50d26-af78-4597-85d5-294217f2b9d3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Flavor limits 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 22:43:23.062324 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-b7c50d26-af78-4597-85d5-294217f2b9d3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Image limits 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 22:43:23.062726 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-b7c50d26-af78-4597-85d5-294217f2b9d3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Flavor pref 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 22:43:23.063316 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-b7c50d26-af78-4597-85d5-294217f2b9d3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Image pref 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 22:43:23.063885 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-b7c50d26-af78-4597-85d5-294217f2b9d3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 22:43:23.074889 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b7c50d26-af78-4597-85d5-294217f2b9d3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:23.075611 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b7c50d26-af78-4597-85d5-294217f2b9d3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:23.076254 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b7c50d26-af78-4597-85d5-294217f2b9d3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:23.077033 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b7c50d26-af78-4597-85d5-294217f2b9d3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:23.077488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b7c50d26-af78-4597-85d5-294217f2b9d3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:23.078005 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b7c50d26-af78-4597-85d5-294217f2b9d3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:23.098078 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-b7c50d26-af78-4597-85d5-294217f2b9d3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Getting quotas for project bcc9a378e7ba4206baaa7bcc683606ca. Resources: {'cores', 'instances', 'ram'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:43:23.103322 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-b7c50d26-af78-4597-85d5-294217f2b9d3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Getting quotas for user acf297d1f1f244dd997992583189c127 and project bcc9a378e7ba4206baaa7bcc683606ca. Resources: {'cores', 'instances', 'ram'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:43:23.118510 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-b7c50d26-af78-4597-85d5-294217f2b9d3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Going to run 1 instances... {{(pid=129964) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 22:43:23.122051 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-b7c50d26-af78-4597-85d5-294217f2b9d3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6d82122-aaf8-4ae2-8368-9740515f5b89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 22:43:23.263043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-b7c50d26-af78-4597-85d5-294217f2b9d3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.123349 Aug 07 22:43:23.264041 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 308/597] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 22:43:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 22:43:23.276648 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-54ac8be9-c46a-4cc2-88bc-527090d374ea tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:23.277304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-54ac8be9-c46a-4cc2-88bc-527090d374ea tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:23.344107 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-54ac8be9-c46a-4cc2-88bc-527090d374ea tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:23.351786 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-54ac8be9-c46a-4cc2-88bc-527090d374ea tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1259 microversion: 2.1 time: 0.079842 Aug 07 22:43:23.354531 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 290/598] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:23 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1259 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:23.623631 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-8b80eb2d-31b6-4e1f-9144-e8192923eaee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:23.624278 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-8b80eb2d-31b6-4e1f-9144-e8192923eaee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:23.630773 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8b80eb2d-31b6-4e1f-9144-e8192923eaee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:23.631253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8b80eb2d-31b6-4e1f-9144-e8192923eaee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:23.632060 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8b80eb2d-31b6-4e1f-9144-e8192923eaee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:23.632997 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8b80eb2d-31b6-4e1f-9144-e8192923eaee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:23.634034 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8b80eb2d-31b6-4e1f-9144-e8192923eaee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:23.634716 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8b80eb2d-31b6-4e1f-9144-e8192923eaee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:23.802434 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-8b80eb2d-31b6-4e1f-9144-e8192923eaee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:23.812692 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-8b80eb2d-31b6-4e1f-9144-e8192923eaee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:23.814569 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-8b80eb2d-31b6-4e1f-9144-e8192923eaee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:23.816388 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-8b80eb2d-31b6-4e1f-9144-e8192923eaee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1740 microversion: 2.20 time: 0.200068 Aug 07 22:43:23.817609 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 309/599] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:23 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:24.377759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-6171f21d-00db-4428-95d3-51d7f3ba615d tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:24.378389 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-6171f21d-00db-4428-95d3-51d7f3ba615d tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:24.459435 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-6171f21d-00db-4428-95d3-51d7f3ba615d tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:24.470519 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-6171f21d-00db-4428-95d3-51d7f3ba615d tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1259 microversion: 2.1 time: 0.098215 Aug 07 22:43:24.490209 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 291/600] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:24 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1259 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:24.846889 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-7f0794ae-cfb0-47b6-8886-8a678c496322 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:24.847480 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-7f0794ae-cfb0-47b6-8886-8a678c496322 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:24.854361 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7f0794ae-cfb0-47b6-8886-8a678c496322 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:24.854844 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7f0794ae-cfb0-47b6-8886-8a678c496322 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:24.855276 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7f0794ae-cfb0-47b6-8886-8a678c496322 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:24.862141 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7f0794ae-cfb0-47b6-8886-8a678c496322 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:24.862141 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7f0794ae-cfb0-47b6-8886-8a678c496322 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:24.862141 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7f0794ae-cfb0-47b6-8886-8a678c496322 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:25.007676 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-7f0794ae-cfb0-47b6-8886-8a678c496322 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:25.017043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-7f0794ae-cfb0-47b6-8886-8a678c496322 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:25.018544 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-7f0794ae-cfb0-47b6-8886-8a678c496322 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:25.019684 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-7f0794ae-cfb0-47b6-8886-8a678c496322 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1740 microversion: 2.20 time: 0.176708 Aug 07 22:43:25.020338 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 310/601] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:24 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:25.495609 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-57d17adf-54fe-40be-a0fd-8af8fe7b105d tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:25.496237 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-57d17adf-54fe-40be-a0fd-8af8fe7b105d tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:25.502948 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-57d17adf-54fe-40be-a0fd-8af8fe7b105d tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:25.503445 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-57d17adf-54fe-40be-a0fd-8af8fe7b105d tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:25.503876 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-57d17adf-54fe-40be-a0fd-8af8fe7b105d tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:25.504628 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-57d17adf-54fe-40be-a0fd-8af8fe7b105d tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:25.505077 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-57d17adf-54fe-40be-a0fd-8af8fe7b105d tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:25.505495 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-57d17adf-54fe-40be-a0fd-8af8fe7b105d tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:25.571973 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-57d17adf-54fe-40be-a0fd-8af8fe7b105d tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:25.579775 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-57d17adf-54fe-40be-a0fd-8af8fe7b105d tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1263 microversion: 2.1 time: 0.088408 Aug 07 22:43:25.580378 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 292/602] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:25 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1263 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:26.055898 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b7a2994b-13c2-4964-8497-6d5ca56d0f0a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:26.056551 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-b7a2994b-13c2-4964-8497-6d5ca56d0f0a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:26.076156 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b7a2994b-13c2-4964-8497-6d5ca56d0f0a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:26.076991 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b7a2994b-13c2-4964-8497-6d5ca56d0f0a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:26.077656 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b7a2994b-13c2-4964-8497-6d5ca56d0f0a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:26.078755 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b7a2994b-13c2-4964-8497-6d5ca56d0f0a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:26.079343 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b7a2994b-13c2-4964-8497-6d5ca56d0f0a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:26.081129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b7a2994b-13c2-4964-8497-6d5ca56d0f0a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:26.237781 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-b7a2994b-13c2-4964-8497-6d5ca56d0f0a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:26.246913 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-b7a2994b-13c2-4964-8497-6d5ca56d0f0a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:26.248876 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-b7a2994b-13c2-4964-8497-6d5ca56d0f0a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:26.250289 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-b7a2994b-13c2-4964-8497-6d5ca56d0f0a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1740 microversion: 2.20 time: 0.209303 Aug 07 22:43:26.250994 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 311/603] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:26 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:26.607507 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7b6f8438-0a3e-4f1d-a7ec-75b5295bbbab tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:26.608175 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-7b6f8438-0a3e-4f1d-a7ec-75b5295bbbab tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:26.615377 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7b6f8438-0a3e-4f1d-a7ec-75b5295bbbab tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:26.616190 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7b6f8438-0a3e-4f1d-a7ec-75b5295bbbab tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:26.616814 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7b6f8438-0a3e-4f1d-a7ec-75b5295bbbab tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:26.618249 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7b6f8438-0a3e-4f1d-a7ec-75b5295bbbab tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:26.618791 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7b6f8438-0a3e-4f1d-a7ec-75b5295bbbab tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:26.619777 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7b6f8438-0a3e-4f1d-a7ec-75b5295bbbab tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:26.692979 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7b6f8438-0a3e-4f1d-a7ec-75b5295bbbab tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:26.701492 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-7b6f8438-0a3e-4f1d-a7ec-75b5295bbbab tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1311 microversion: 2.1 time: 0.103019 Aug 07 22:43:26.702475 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 293/604] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:26 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:27.274254 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-373c8ce7-4fe7-46a2-b3e3-adae5fa2e43d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:27.275016 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-373c8ce7-4fe7-46a2-b3e3-adae5fa2e43d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:27.292897 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-373c8ce7-4fe7-46a2-b3e3-adae5fa2e43d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:27.293621 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-373c8ce7-4fe7-46a2-b3e3-adae5fa2e43d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:27.294222 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-373c8ce7-4fe7-46a2-b3e3-adae5fa2e43d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:27.295133 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-373c8ce7-4fe7-46a2-b3e3-adae5fa2e43d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:27.295740 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-373c8ce7-4fe7-46a2-b3e3-adae5fa2e43d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:27.296345 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-373c8ce7-4fe7-46a2-b3e3-adae5fa2e43d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:27.552708 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-373c8ce7-4fe7-46a2-b3e3-adae5fa2e43d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:27.566407 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-373c8ce7-4fe7-46a2-b3e3-adae5fa2e43d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:27.572312 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-373c8ce7-4fe7-46a2-b3e3-adae5fa2e43d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:27.575288 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-373c8ce7-4fe7-46a2-b3e3-adae5fa2e43d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1740 microversion: 2.20 time: 0.305512 Aug 07 22:43:27.577393 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 312/605] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:27 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1740 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:27.722940 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-345e0282-d834-4b91-8a60-98b1d70ed8df tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:27.724381 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-345e0282-d834-4b91-8a60-98b1d70ed8df tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:27.732823 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-345e0282-d834-4b91-8a60-98b1d70ed8df tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:27.733689 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-345e0282-d834-4b91-8a60-98b1d70ed8df tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:27.734488 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-345e0282-d834-4b91-8a60-98b1d70ed8df tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:27.735410 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-345e0282-d834-4b91-8a60-98b1d70ed8df tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:27.736122 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-345e0282-d834-4b91-8a60-98b1d70ed8df tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:27.736916 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-345e0282-d834-4b91-8a60-98b1d70ed8df tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:27.846123 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-345e0282-d834-4b91-8a60-98b1d70ed8df tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:27.857332 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-345e0282-d834-4b91-8a60-98b1d70ed8df tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1317 microversion: 2.1 time: 0.138187 Aug 07 22:43:27.873230 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 294/606] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:27 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:28.605527 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-d5923c25-5cc5-4dd4-a25f-a0913d063820 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:28.607377 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-d5923c25-5cc5-4dd4-a25f-a0913d063820 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:28.614513 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d5923c25-5cc5-4dd4-a25f-a0913d063820 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:28.615107 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d5923c25-5cc5-4dd4-a25f-a0913d063820 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:28.615615 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d5923c25-5cc5-4dd4-a25f-a0913d063820 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:28.616456 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d5923c25-5cc5-4dd4-a25f-a0913d063820 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:28.617074 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d5923c25-5cc5-4dd4-a25f-a0913d063820 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:28.617748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d5923c25-5cc5-4dd4-a25f-a0913d063820 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:28.863011 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-d5923c25-5cc5-4dd4-a25f-a0913d063820 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:28.889228 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-02ee0b16-ff3d-485b-ba36-5056fdd6838e tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:28.890379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-d5923c25-5cc5-4dd4-a25f-a0913d063820 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:28.891461 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-02ee0b16-ff3d-485b-ba36-5056fdd6838e tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:28.892634 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-d5923c25-5cc5-4dd4-a25f-a0913d063820 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:28.894872 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-d5923c25-5cc5-4dd4-a25f-a0913d063820 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1740 microversion: 2.20 time: 0.294590 Aug 07 22:43:28.896866 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 313/607] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:28 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1740 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:28.902411 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-02ee0b16-ff3d-485b-ba36-5056fdd6838e tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:28.902915 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-02ee0b16-ff3d-485b-ba36-5056fdd6838e tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:28.903414 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-02ee0b16-ff3d-485b-ba36-5056fdd6838e tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:28.904511 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-02ee0b16-ff3d-485b-ba36-5056fdd6838e tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:28.904982 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-02ee0b16-ff3d-485b-ba36-5056fdd6838e tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:28.905416 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-02ee0b16-ff3d-485b-ba36-5056fdd6838e tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:29.223558 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-02ee0b16-ff3d-485b-ba36-5056fdd6838e tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:29.231465 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-02ee0b16-ff3d-485b-ba36-5056fdd6838e tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1359 microversion: 2.1 time: 0.348532 Aug 07 22:43:29.232141 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 295/608] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:28 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1359 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:43:29.925532 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-d8a81639-d06b-479f-b0f8-db4604cc9867 req-f974d274-f400-456f-a7e2-dca7f6de5222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de8d1496-5f71-442d-b1b0-712a7b4f598d", "tag": "332a7e9e-deb8-4c55-afbc-6a7faca02b5e"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:43:29.926806 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-58951143-a0f1-43aa-a459-42c5125de2bd tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:29.931605 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-58951143-a0f1-43aa-a459-42c5125de2bd tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:29.952451 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-58951143-a0f1-43aa-a459-42c5125de2bd tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:29.958804 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-d8a81639-d06b-479f-b0f8-db4604cc9867 req-f974d274-f400-456f-a7e2-dca7f6de5222 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:29.979376 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-58951143-a0f1-43aa-a459-42c5125de2bd tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:29.985176 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-58951143-a0f1-43aa-a459-42c5125de2bd tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:29.987600 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-58951143-a0f1-43aa-a459-42c5125de2bd tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:29.988530 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-d8a81639-d06b-479f-b0f8-db4604cc9867 req-f974d274-f400-456f-a7e2-dca7f6de5222 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:29.990534 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-58951143-a0f1-43aa-a459-42c5125de2bd tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:29.991302 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-d8a81639-d06b-479f-b0f8-db4604cc9867 req-f974d274-f400-456f-a7e2-dca7f6de5222 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:29.992587 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-58951143-a0f1-43aa-a459-42c5125de2bd tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:30.040393 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-d8a81639-d06b-479f-b0f8-db4604cc9867 req-f974d274-f400-456f-a7e2-dca7f6de5222 service nova] Creating event network-changed:332a7e9e-deb8-4c55-afbc-6a7faca02b5e for instance de8d1496-5f71-442d-b1b0-712a7b4f598d on hv-cinder-85032 Aug 07 22:43:30.049918 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-d8a81639-d06b-479f-b0f8-db4604cc9867 req-f974d274-f400-456f-a7e2-dca7f6de5222 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129462 Aug 07 22:43:30.052490 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 296/609] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:43:30.259276 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d6743f41-3c8e-46ad-bcad-92463467a179 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:30.260485 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-d6743f41-3c8e-46ad-bcad-92463467a179 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:30.272865 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-58951143-a0f1-43aa-a459-42c5125de2bd tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:30.285741 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d6743f41-3c8e-46ad-bcad-92463467a179 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:30.286915 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d6743f41-3c8e-46ad-bcad-92463467a179 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:30.288304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d6743f41-3c8e-46ad-bcad-92463467a179 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:30.288606 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-58951143-a0f1-43aa-a459-42c5125de2bd tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:30.290513 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d6743f41-3c8e-46ad-bcad-92463467a179 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:30.292242 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d6743f41-3c8e-46ad-bcad-92463467a179 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:30.293114 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-58951143-a0f1-43aa-a459-42c5125de2bd tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:30.293967 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d6743f41-3c8e-46ad-bcad-92463467a179 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:30.295348 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-58951143-a0f1-43aa-a459-42c5125de2bd tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1740 microversion: 2.20 time: 0.378561 Aug 07 22:43:30.298479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 314/610] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:29 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1740 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:30.620890 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-d6743f41-3c8e-46ad-bcad-92463467a179 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:30.630198 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-d6743f41-3c8e-46ad-bcad-92463467a179 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1359 microversion: 2.1 time: 0.377027 Aug 07 22:43:30.652127 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 297/611] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:30 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1359 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:31.323223 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-4f96a994-cdd8-46b5-994e-e57c30bd9d5c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:31.324630 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-4f96a994-cdd8-46b5-994e-e57c30bd9d5c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:31.334790 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4f96a994-cdd8-46b5-994e-e57c30bd9d5c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:31.336443 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4f96a994-cdd8-46b5-994e-e57c30bd9d5c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:31.337115 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4f96a994-cdd8-46b5-994e-e57c30bd9d5c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:31.338026 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4f96a994-cdd8-46b5-994e-e57c30bd9d5c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:31.338672 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4f96a994-cdd8-46b5-994e-e57c30bd9d5c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:31.339314 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4f96a994-cdd8-46b5-994e-e57c30bd9d5c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:31.656922 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-b2f20248-61c9-472e-8be4-f87a74360ffe tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:31.658258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-b2f20248-61c9-472e-8be4-f87a74360ffe tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:31.684150 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b2f20248-61c9-472e-8be4-f87a74360ffe tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:31.684929 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b2f20248-61c9-472e-8be4-f87a74360ffe tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:31.685536 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b2f20248-61c9-472e-8be4-f87a74360ffe tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:31.686429 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b2f20248-61c9-472e-8be4-f87a74360ffe tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:31.687047 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b2f20248-61c9-472e-8be4-f87a74360ffe tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:31.687633 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b2f20248-61c9-472e-8be4-f87a74360ffe tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:31.722054 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-4f96a994-cdd8-46b5-994e-e57c30bd9d5c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:31.730798 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-4f96a994-cdd8-46b5-994e-e57c30bd9d5c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:31.732322 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-4f96a994-cdd8-46b5-994e-e57c30bd9d5c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:31.733551 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-4f96a994-cdd8-46b5-994e-e57c30bd9d5c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1740 microversion: 2.20 time: 0.415815 Aug 07 22:43:31.734345 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 315/612] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:31 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1740 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:31.953026 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-b2f20248-61c9-472e-8be4-f87a74360ffe tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:31.958258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=100 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:31.964147 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-b2f20248-61c9-472e-8be4-f87a74360ffe tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1359 microversion: 2.1 time: 0.312301 Aug 07 22:43:31.976060 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 298/613] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:31 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1359 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:43:32.140638 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-80707b39-33ea-4879-b6f0-8b17283bf413 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:32.141516 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-80707b39-33ea-4879-b6f0-8b17283bf413 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:32.156246 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-80707b39-33ea-4879-b6f0-8b17283bf413 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:32.157118 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-80707b39-33ea-4879-b6f0-8b17283bf413 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:32.158841 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-80707b39-33ea-4879-b6f0-8b17283bf413 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:32.163357 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-80707b39-33ea-4879-b6f0-8b17283bf413 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:32.165752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-80707b39-33ea-4879-b6f0-8b17283bf413 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:32.168072 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-80707b39-33ea-4879-b6f0-8b17283bf413 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:32.286010 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-80707b39-33ea-4879-b6f0-8b17283bf413 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Going to try to terminate instance {{(pid=129964) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 22:43:32.761126 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-69426ba3-98ab-418a-82c2-f253a369684a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:32.762435 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-69426ba3-98ab-418a-82c2-f253a369684a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:32.769413 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-69426ba3-98ab-418a-82c2-f253a369684a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:32.770201 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-69426ba3-98ab-418a-82c2-f253a369684a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:32.770802 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-69426ba3-98ab-418a-82c2-f253a369684a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:32.771668 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-69426ba3-98ab-418a-82c2-f253a369684a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:32.773972 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-69426ba3-98ab-418a-82c2-f253a369684a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:32.774713 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-69426ba3-98ab-418a-82c2-f253a369684a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:32.973259 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-80707b39-33ea-4879-b6f0-8b17283bf413 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "DELETE /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 204 len: 0 microversion: 2.1 time: 0.836307 Aug 07 22:43:32.974632 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 316/614] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:43:32 2022] DELETE /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 0 bytes in 839 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 22:43:32.984259 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b81729fa-8fdc-4c72-84f6-576fd8d62628 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:32.985318 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-b81729fa-8fdc-4c72-84f6-576fd8d62628 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:33.020075 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b81729fa-8fdc-4c72-84f6-576fd8d62628 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:33.020472 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b81729fa-8fdc-4c72-84f6-576fd8d62628 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:33.021624 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b81729fa-8fdc-4c72-84f6-576fd8d62628 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:33.035355 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b81729fa-8fdc-4c72-84f6-576fd8d62628 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:33.035851 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b81729fa-8fdc-4c72-84f6-576fd8d62628 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:33.038354 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b81729fa-8fdc-4c72-84f6-576fd8d62628 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:33.065824 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-69426ba3-98ab-418a-82c2-f253a369684a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:33.084053 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-69426ba3-98ab-418a-82c2-f253a369684a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:33.088695 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-69426ba3-98ab-418a-82c2-f253a369684a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:33.093315 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=2 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:33.111253 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-69426ba3-98ab-418a-82c2-f253a369684a tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1740 microversion: 2.20 time: 0.346034 Aug 07 22:43:33.124171 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=10 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:33.132238 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 299/615] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:32 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1740 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:43:33.157333 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-b4a03e5d-db8e-4612-9497-c9e2e32959e0 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:33.158253 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-b4a03e5d-db8e-4612-9497-c9e2e32959e0 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:33.169146 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b4a03e5d-db8e-4612-9497-c9e2e32959e0 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:33.171444 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b4a03e5d-db8e-4612-9497-c9e2e32959e0 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:33.172104 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b4a03e5d-db8e-4612-9497-c9e2e32959e0 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:33.174347 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b4a03e5d-db8e-4612-9497-c9e2e32959e0 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:33.189400 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b4a03e5d-db8e-4612-9497-c9e2e32959e0 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:33.191899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b4a03e5d-db8e-4612-9497-c9e2e32959e0 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:33.446835 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-b81729fa-8fdc-4c72-84f6-576fd8d62628 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:33.451842 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-b4a03e5d-db8e-4612-9497-c9e2e32959e0 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:33.462800 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-b81729fa-8fdc-4c72-84f6-576fd8d62628 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1578 microversion: 2.1 time: 0.478113 Aug 07 22:43:33.464130 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 317/616] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:32 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1578 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:43:33.464718 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-b4a03e5d-db8e-4612-9497-c9e2e32959e0 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1359 microversion: 2.1 time: 0.330181 Aug 07 22:43:33.465326 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 300/617] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:33 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1359 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:34.147149 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-4e3cda27-df49-48bd-a206-2cf800e94627 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:34.149164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-4e3cda27-df49-48bd-a206-2cf800e94627 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:34.156914 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4e3cda27-df49-48bd-a206-2cf800e94627 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:34.157442 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4e3cda27-df49-48bd-a206-2cf800e94627 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:34.157841 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4e3cda27-df49-48bd-a206-2cf800e94627 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:34.158733 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4e3cda27-df49-48bd-a206-2cf800e94627 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:34.159008 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4e3cda27-df49-48bd-a206-2cf800e94627 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:34.159427 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4e3cda27-df49-48bd-a206-2cf800e94627 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:34.317174 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-4e3cda27-df49-48bd-a206-2cf800e94627 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:34.333354 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-4e3cda27-df49-48bd-a206-2cf800e94627 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:34.334928 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-4e3cda27-df49-48bd-a206-2cf800e94627 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:34.336830 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-4e3cda27-df49-48bd-a206-2cf800e94627 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1740 microversion: 2.20 time: 0.193872 Aug 07 22:43:34.337547 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 318/618] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:34 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:34.495414 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-6331d152-709d-4669-990e-e3c6e9ccffb3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:34.502097 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-7d250019-39f4-4947-b11b-827300890504 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:34.502097 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-7d250019-39f4-4947-b11b-827300890504 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:34.502304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-6331d152-709d-4669-990e-e3c6e9ccffb3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:34.504049 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=4 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:34.513598 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7d250019-39f4-4947-b11b-827300890504 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:34.514103 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7d250019-39f4-4947-b11b-827300890504 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:34.514565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7d250019-39f4-4947-b11b-827300890504 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:34.515285 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7d250019-39f4-4947-b11b-827300890504 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:34.515738 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7d250019-39f4-4947-b11b-827300890504 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:34.516228 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7d250019-39f4-4947-b11b-827300890504 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:34.521401 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6331d152-709d-4669-990e-e3c6e9ccffb3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:34.524529 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6331d152-709d-4669-990e-e3c6e9ccffb3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:34.524529 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6331d152-709d-4669-990e-e3c6e9ccffb3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:34.524529 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6331d152-709d-4669-990e-e3c6e9ccffb3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:34.524529 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6331d152-709d-4669-990e-e3c6e9ccffb3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:34.524963 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6331d152-709d-4669-990e-e3c6e9ccffb3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:34.737627 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-7d250019-39f4-4947-b11b-827300890504 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:34.747340 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-6331d152-709d-4669-990e-e3c6e9ccffb3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:34.755787 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-7d250019-39f4-4947-b11b-827300890504 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1578 microversion: 2.1 time: 0.270991 Aug 07 22:43:34.758866 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-6331d152-709d-4669-990e-e3c6e9ccffb3 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1359 microversion: 2.1 time: 0.277432 Aug 07 22:43:34.776042 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 319/619] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:34 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1578 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:34.776993 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 301/620] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:34 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1359 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:35.363302 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-9f8a386e-e70e-4e48-9dfa-13755761304c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:35.364619 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-9f8a386e-e70e-4e48-9dfa-13755761304c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:35.377492 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9f8a386e-e70e-4e48-9dfa-13755761304c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:35.378941 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9f8a386e-e70e-4e48-9dfa-13755761304c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:35.379643 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9f8a386e-e70e-4e48-9dfa-13755761304c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:35.380592 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9f8a386e-e70e-4e48-9dfa-13755761304c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:35.381314 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9f8a386e-e70e-4e48-9dfa-13755761304c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:35.386269 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9f8a386e-e70e-4e48-9dfa-13755761304c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:35.557647 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-9f8a386e-e70e-4e48-9dfa-13755761304c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:35.566965 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-9f8a386e-e70e-4e48-9dfa-13755761304c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:35.568565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-9f8a386e-e70e-4e48-9dfa-13755761304c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:35.572136 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-9f8a386e-e70e-4e48-9dfa-13755761304c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1740 microversion: 2.20 time: 0.213732 Aug 07 22:43:35.573423 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 320/621] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:35 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1740 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:35.782093 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-c9efce8a-aa13-47d0-80e4-b8ac61ad8edd tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:35.783295 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-c9efce8a-aa13-47d0-80e4-b8ac61ad8edd tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:35.792216 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-2bc2d04c-3156-4ae8-96f0-2b786336d632 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:35.792677 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-2bc2d04c-3156-4ae8-96f0-2b786336d632 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:35.800637 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c9efce8a-aa13-47d0-80e4-b8ac61ad8edd tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:35.801127 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c9efce8a-aa13-47d0-80e4-b8ac61ad8edd tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:35.801551 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c9efce8a-aa13-47d0-80e4-b8ac61ad8edd tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:35.802255 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c9efce8a-aa13-47d0-80e4-b8ac61ad8edd tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:35.802557 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2bc2d04c-3156-4ae8-96f0-2b786336d632 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:35.802826 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c9efce8a-aa13-47d0-80e4-b8ac61ad8edd tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:35.803275 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2bc2d04c-3156-4ae8-96f0-2b786336d632 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:35.803916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2bc2d04c-3156-4ae8-96f0-2b786336d632 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:35.805884 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2bc2d04c-3156-4ae8-96f0-2b786336d632 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:35.807018 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2bc2d04c-3156-4ae8-96f0-2b786336d632 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:35.807617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2bc2d04c-3156-4ae8-96f0-2b786336d632 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:35.813292 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c9efce8a-aa13-47d0-80e4-b8ac61ad8edd tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:36.045619 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-c9efce8a-aa13-47d0-80e4-b8ac61ad8edd tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:36.050300 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-2bc2d04c-3156-4ae8-96f0-2b786336d632 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:36.052492 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:36.057838 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-c9efce8a-aa13-47d0-80e4-b8ac61ad8edd tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1359 microversion: 2.1 time: 0.279586 Aug 07 22:43:36.068646 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-2bc2d04c-3156-4ae8-96f0-2b786336d632 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1578 microversion: 2.1 time: 0.273669 Aug 07 22:43:36.068646 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 321/622] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:35 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1578 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:36.081368 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 302/623] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:35 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1359 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:36.595596 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-c9fae554-0eaf-4cb2-9ec3-05aa486f1322 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:36.596194 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-c9fae554-0eaf-4cb2-9ec3-05aa486f1322 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:36.603879 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c9fae554-0eaf-4cb2-9ec3-05aa486f1322 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:36.604690 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c9fae554-0eaf-4cb2-9ec3-05aa486f1322 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:36.605287 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c9fae554-0eaf-4cb2-9ec3-05aa486f1322 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:36.606195 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c9fae554-0eaf-4cb2-9ec3-05aa486f1322 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:36.606809 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c9fae554-0eaf-4cb2-9ec3-05aa486f1322 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:36.607404 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c9fae554-0eaf-4cb2-9ec3-05aa486f1322 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:36.781949 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-c9fae554-0eaf-4cb2-9ec3-05aa486f1322 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:36.790595 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-c9fae554-0eaf-4cb2-9ec3-05aa486f1322 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:36.793105 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-c9fae554-0eaf-4cb2-9ec3-05aa486f1322 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:36.794284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-c9fae554-0eaf-4cb2-9ec3-05aa486f1322 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1740 microversion: 2.20 time: 0.203309 Aug 07 22:43:36.795158 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 322/624] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:36 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:37.085427 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-6266cc21-2365-45e0-9fa5-b798fac2989d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:37.086654 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-6266cc21-2365-45e0-9fa5-b798fac2989d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:37.093624 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6266cc21-2365-45e0-9fa5-b798fac2989d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:37.094374 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6266cc21-2365-45e0-9fa5-b798fac2989d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:37.095012 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6266cc21-2365-45e0-9fa5-b798fac2989d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:37.095570 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-03fbe52b-d65f-4b92-b642-cafb97e710fa tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:37.096179 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6266cc21-2365-45e0-9fa5-b798fac2989d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:37.096394 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-03fbe52b-d65f-4b92-b642-cafb97e710fa tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:37.097415 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6266cc21-2365-45e0-9fa5-b798fac2989d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:37.098251 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6266cc21-2365-45e0-9fa5-b798fac2989d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:37.106409 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-03fbe52b-d65f-4b92-b642-cafb97e710fa tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:37.106409 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-03fbe52b-d65f-4b92-b642-cafb97e710fa tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:37.106409 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-03fbe52b-d65f-4b92-b642-cafb97e710fa tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:37.106409 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-03fbe52b-d65f-4b92-b642-cafb97e710fa tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:37.106862 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-03fbe52b-d65f-4b92-b642-cafb97e710fa tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:37.106862 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-03fbe52b-d65f-4b92-b642-cafb97e710fa tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:37.338124 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-6266cc21-2365-45e0-9fa5-b798fac2989d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:37.348548 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-03fbe52b-d65f-4b92-b642-cafb97e710fa tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:37.350264 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-6266cc21-2365-45e0-9fa5-b798fac2989d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1578 microversion: 2.1 time: 0.268788 Aug 07 22:43:37.353182 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 303/625] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:37 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1578 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:37.361421 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-03fbe52b-d65f-4b92-b642-cafb97e710fa tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1359 microversion: 2.1 time: 0.270188 Aug 07 22:43:37.372309 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 323/626] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:37 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1359 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:43:37.821724 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-f1876d4d-aa92-47c9-b4cb-f0c808d569f6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:37.822323 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-f1876d4d-aa92-47c9-b4cb-f0c808d569f6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:37.828797 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f1876d4d-aa92-47c9-b4cb-f0c808d569f6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:37.829588 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f1876d4d-aa92-47c9-b4cb-f0c808d569f6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:37.830030 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f1876d4d-aa92-47c9-b4cb-f0c808d569f6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:37.830729 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f1876d4d-aa92-47c9-b4cb-f0c808d569f6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:37.831180 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f1876d4d-aa92-47c9-b4cb-f0c808d569f6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:37.831602 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f1876d4d-aa92-47c9-b4cb-f0c808d569f6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:38.003341 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f1876d4d-aa92-47c9-b4cb-f0c808d569f6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:38.015558 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f1876d4d-aa92-47c9-b4cb-f0c808d569f6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:38.017631 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f1876d4d-aa92-47c9-b4cb-f0c808d569f6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:38.019381 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-f1876d4d-aa92-47c9-b4cb-f0c808d569f6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1740 microversion: 2.20 time: 0.202313 Aug 07 22:43:38.035670 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 304/627] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:37 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:38.373242 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b3b1afa3-6826-4a4a-9bc9-58f28ef0869e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:38.373882 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-b3b1afa3-6826-4a4a-9bc9-58f28ef0869e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:38.380898 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b3b1afa3-6826-4a4a-9bc9-58f28ef0869e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:38.381380 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b3b1afa3-6826-4a4a-9bc9-58f28ef0869e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:38.381812 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b3b1afa3-6826-4a4a-9bc9-58f28ef0869e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:38.383076 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b3b1afa3-6826-4a4a-9bc9-58f28ef0869e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:38.383614 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b3b1afa3-6826-4a4a-9bc9-58f28ef0869e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:38.384058 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b3b1afa3-6826-4a4a-9bc9-58f28ef0869e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:38.393526 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-b1a76625-d088-47e8-a89d-953287d31159 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:38.394951 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-b1a76625-d088-47e8-a89d-953287d31159 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:38.402535 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b1a76625-d088-47e8-a89d-953287d31159 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:38.403571 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b1a76625-d088-47e8-a89d-953287d31159 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:38.404114 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b1a76625-d088-47e8-a89d-953287d31159 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:38.405045 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b1a76625-d088-47e8-a89d-953287d31159 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:38.405878 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b1a76625-d088-47e8-a89d-953287d31159 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:38.406508 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b1a76625-d088-47e8-a89d-953287d31159 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:38.638006 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-b3b1afa3-6826-4a4a-9bc9-58f28ef0869e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:38.651065 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-b3b1afa3-6826-4a4a-9bc9-58f28ef0869e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1578 microversion: 2.1 time: 0.281644 Aug 07 22:43:38.652000 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 324/628] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:38 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1578 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:38.686557 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-b1a76625-d088-47e8-a89d-953287d31159 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:38.694604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-b1a76625-d088-47e8-a89d-953287d31159 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1359 microversion: 2.1 time: 0.305227 Aug 07 22:43:38.695650 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 305/629] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:38 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1359 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:43:39.051075 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-083d7345-08f8-47d5-a8c0-0b9416c0caf6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:39.051674 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-083d7345-08f8-47d5-a8c0-0b9416c0caf6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:39.058365 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-083d7345-08f8-47d5-a8c0-0b9416c0caf6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:39.059505 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-083d7345-08f8-47d5-a8c0-0b9416c0caf6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:39.059505 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-083d7345-08f8-47d5-a8c0-0b9416c0caf6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:39.059953 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-083d7345-08f8-47d5-a8c0-0b9416c0caf6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:39.060436 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-083d7345-08f8-47d5-a8c0-0b9416c0caf6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:39.060953 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-083d7345-08f8-47d5-a8c0-0b9416c0caf6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:39.193456 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-083d7345-08f8-47d5-a8c0-0b9416c0caf6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:39.202277 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-083d7345-08f8-47d5-a8c0-0b9416c0caf6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:39.203843 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-083d7345-08f8-47d5-a8c0-0b9416c0caf6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:39.205009 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-083d7345-08f8-47d5-a8c0-0b9416c0caf6 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1740 microversion: 2.20 time: 0.158121 Aug 07 22:43:39.211350 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 325/630] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:39 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:39.674892 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7fe24607-bd25-45ca-9419-3e3308238caa tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:39.674892 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-7fe24607-bd25-45ca-9419-3e3308238caa tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:39.681025 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7fe24607-bd25-45ca-9419-3e3308238caa tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:39.681505 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7fe24607-bd25-45ca-9419-3e3308238caa tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:39.681962 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7fe24607-bd25-45ca-9419-3e3308238caa tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:39.682651 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7fe24607-bd25-45ca-9419-3e3308238caa tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:39.683096 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7fe24607-bd25-45ca-9419-3e3308238caa tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:39.685379 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7fe24607-bd25-45ca-9419-3e3308238caa tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:39.715922 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-30342c7f-0f7a-4ff0-ad2d-79b858b50e1a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:39.717755 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-30342c7f-0f7a-4ff0-ad2d-79b858b50e1a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:39.723913 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:39.725382 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-30342c7f-0f7a-4ff0-ad2d-79b858b50e1a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:39.725859 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-30342c7f-0f7a-4ff0-ad2d-79b858b50e1a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:39.727052 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-30342c7f-0f7a-4ff0-ad2d-79b858b50e1a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:39.728034 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-30342c7f-0f7a-4ff0-ad2d-79b858b50e1a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:39.728643 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-30342c7f-0f7a-4ff0-ad2d-79b858b50e1a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:39.729222 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-30342c7f-0f7a-4ff0-ad2d-79b858b50e1a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:39.884113 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7fe24607-bd25-45ca-9419-3e3308238caa tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:39.891985 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-7fe24607-bd25-45ca-9419-3e3308238caa tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1578 microversion: 2.1 time: 0.222193 Aug 07 22:43:39.892586 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 306/631] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:39 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1578 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:39.909215 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-30342c7f-0f7a-4ff0-ad2d-79b858b50e1a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:39.917103 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-30342c7f-0f7a-4ff0-ad2d-79b858b50e1a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1359 microversion: 2.1 time: 0.205504 Aug 07 22:43:39.917754 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 326/632] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:39 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:43:40.228557 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-8c955354-72ad-419d-8336-a852ea28a4a1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:40.229080 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-8c955354-72ad-419d-8336-a852ea28a4a1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:40.235008 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8c955354-72ad-419d-8336-a852ea28a4a1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:40.235486 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8c955354-72ad-419d-8336-a852ea28a4a1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:40.235919 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8c955354-72ad-419d-8336-a852ea28a4a1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:40.236638 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8c955354-72ad-419d-8336-a852ea28a4a1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:40.237093 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8c955354-72ad-419d-8336-a852ea28a4a1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:40.237518 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8c955354-72ad-419d-8336-a852ea28a4a1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:40.371668 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8c955354-72ad-419d-8336-a852ea28a4a1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:40.379610 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8c955354-72ad-419d-8336-a852ea28a4a1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:40.384780 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8c955354-72ad-419d-8336-a852ea28a4a1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:40.384780 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-8c955354-72ad-419d-8336-a852ea28a4a1 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1740 microversion: 2.20 time: 0.158381 Aug 07 22:43:40.384780 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 307/633] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:40 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:40.913484 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-31b9fef3-2505-4125-b0ce-829901002e84 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:40.914285 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-31b9fef3-2505-4125-b0ce-829901002e84 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:40.920777 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-31b9fef3-2505-4125-b0ce-829901002e84 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:40.921254 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-31b9fef3-2505-4125-b0ce-829901002e84 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:40.921689 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-31b9fef3-2505-4125-b0ce-829901002e84 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:40.922373 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-31b9fef3-2505-4125-b0ce-829901002e84 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:40.922821 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-31b9fef3-2505-4125-b0ce-829901002e84 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:40.923245 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-31b9fef3-2505-4125-b0ce-829901002e84 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:40.938654 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-33365fd1-dc04-4f25-bec9-2cd171aff4b8 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:40.939269 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-33365fd1-dc04-4f25-bec9-2cd171aff4b8 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:40.941611 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=60 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:40.947648 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-33365fd1-dc04-4f25-bec9-2cd171aff4b8 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:40.955081 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-33365fd1-dc04-4f25-bec9-2cd171aff4b8 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:40.955081 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-33365fd1-dc04-4f25-bec9-2cd171aff4b8 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:40.955081 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-33365fd1-dc04-4f25-bec9-2cd171aff4b8 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:40.955081 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-33365fd1-dc04-4f25-bec9-2cd171aff4b8 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:40.955432 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-33365fd1-dc04-4f25-bec9-2cd171aff4b8 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:41.130479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-31b9fef3-2505-4125-b0ce-829901002e84 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:41.139003 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-31b9fef3-2505-4125-b0ce-829901002e84 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1578 microversion: 2.1 time: 0.229282 Aug 07 22:43:41.139571 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 327/634] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:40 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1578 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:41.142556 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-33365fd1-dc04-4f25-bec9-2cd171aff4b8 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:41.154139 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-33365fd1-dc04-4f25-bec9-2cd171aff4b8 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1359 microversion: 2.1 time: 0.219240 Aug 07 22:43:41.154725 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 308/635] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:40 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:43:41.406943 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-22e1294f-9fe4-4d79-990c-6534b0ba71de tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:41.407459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-22e1294f-9fe4-4d79-990c-6534b0ba71de tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:41.413884 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-22e1294f-9fe4-4d79-990c-6534b0ba71de tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:41.414403 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-22e1294f-9fe4-4d79-990c-6534b0ba71de tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:41.414844 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-22e1294f-9fe4-4d79-990c-6534b0ba71de tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:41.415608 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-22e1294f-9fe4-4d79-990c-6534b0ba71de tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:41.416112 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-22e1294f-9fe4-4d79-990c-6534b0ba71de tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:41.416533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-22e1294f-9fe4-4d79-990c-6534b0ba71de tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:41.666666 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-22e1294f-9fe4-4d79-990c-6534b0ba71de tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:41.677774 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-22e1294f-9fe4-4d79-990c-6534b0ba71de tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:41.680221 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-22e1294f-9fe4-4d79-990c-6534b0ba71de tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:41.681611 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-22e1294f-9fe4-4d79-990c-6534b0ba71de tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1722 microversion: 2.20 time: 0.278684 Aug 07 22:43:41.682285 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 328/636] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:41 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1722 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:42.166089 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-0d6394eb-7a92-44a1-971b-163b5afc399c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:42.167315 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-0d6394eb-7a92-44a1-971b-163b5afc399c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:42.174505 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0d6394eb-7a92-44a1-971b-163b5afc399c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:42.174736 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-104c1672-852f-4449-b385-1386e1cf452d tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:42.175399 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-104c1672-852f-4449-b385-1386e1cf452d tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:42.176272 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0d6394eb-7a92-44a1-971b-163b5afc399c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:42.176881 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0d6394eb-7a92-44a1-971b-163b5afc399c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:42.178307 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0d6394eb-7a92-44a1-971b-163b5afc399c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:42.183196 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-104c1672-852f-4449-b385-1386e1cf452d tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:42.183599 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-104c1672-852f-4449-b385-1386e1cf452d tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:42.184054 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-104c1672-852f-4449-b385-1386e1cf452d tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:42.188582 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-104c1672-852f-4449-b385-1386e1cf452d tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:42.188819 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0d6394eb-7a92-44a1-971b-163b5afc399c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:42.189212 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-104c1672-852f-4449-b385-1386e1cf452d tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:42.189649 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-104c1672-852f-4449-b385-1386e1cf452d tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:42.193514 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0d6394eb-7a92-44a1-971b-163b5afc399c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:42.300776 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-0d6394eb-7a92-44a1-971b-163b5afc399c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:42.311065 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-0d6394eb-7a92-44a1-971b-163b5afc399c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1510 microversion: 2.1 time: 0.154135 Aug 07 22:43:42.312170 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 309/637] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:42 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:42.377591 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-104c1672-852f-4449-b385-1386e1cf452d tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:42.385187 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-104c1672-852f-4449-b385-1386e1cf452d tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1359 microversion: 2.1 time: 0.214436 Aug 07 22:43:42.386504 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 329/638] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:42 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:43:42.652036 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-e30589cc-4968-4fc8-9535-23b7341b3ba0 req-78689994-41bf-4e96-a057-027769c9ad06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "750b85bc-6bb0-48e2-a912-7664384bcaa0", "name": "network-vif-deleted", "tag": "c6e7b289-4e50-424d-9310-ffa0f3386876"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:43:42.662344 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-e30589cc-4968-4fc8-9535-23b7341b3ba0 req-78689994-41bf-4e96-a057-027769c9ad06 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:42.662818 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-e30589cc-4968-4fc8-9535-23b7341b3ba0 req-78689994-41bf-4e96-a057-027769c9ad06 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:42.663244 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-e30589cc-4968-4fc8-9535-23b7341b3ba0 req-78689994-41bf-4e96-a057-027769c9ad06 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:42.676255 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-e30589cc-4968-4fc8-9535-23b7341b3ba0 req-78689994-41bf-4e96-a057-027769c9ad06 service nova] Creating event network-vif-deleted:c6e7b289-4e50-424d-9310-ffa0f3386876 for instance 750b85bc-6bb0-48e2-a912-7664384bcaa0 on hv-cinder-85032 Aug 07 22:43:42.682981 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-e30589cc-4968-4fc8-9535-23b7341b3ba0 req-78689994-41bf-4e96-a057-027769c9ad06 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189214 Aug 07 22:43:42.683661 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 310/639] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:43:42.715458 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-fd0cb32d-1f6f-4fb3-b3af-f8f90b26b897 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:42.715995 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-fd0cb32d-1f6f-4fb3-b3af-f8f90b26b897 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:42.723781 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fd0cb32d-1f6f-4fb3-b3af-f8f90b26b897 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:42.724902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fd0cb32d-1f6f-4fb3-b3af-f8f90b26b897 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:42.725349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fd0cb32d-1f6f-4fb3-b3af-f8f90b26b897 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:42.726358 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fd0cb32d-1f6f-4fb3-b3af-f8f90b26b897 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:42.726893 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fd0cb32d-1f6f-4fb3-b3af-f8f90b26b897 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:42.727317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fd0cb32d-1f6f-4fb3-b3af-f8f90b26b897 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:42.864086 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-fd0cb32d-1f6f-4fb3-b3af-f8f90b26b897 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:42.872310 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-fd0cb32d-1f6f-4fb3-b3af-f8f90b26b897 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:42.873889 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-fd0cb32d-1f6f-4fb3-b3af-f8f90b26b897 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:42.875091 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-fd0cb32d-1f6f-4fb3-b3af-f8f90b26b897 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1722 microversion: 2.20 time: 0.163926 Aug 07 22:43:42.875737 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 330/640] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:42 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:43.337289 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-a0a12726-392a-4bea-b44d-486994f4702f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:43.338022 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-a0a12726-392a-4bea-b44d-486994f4702f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:43.344131 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a0a12726-392a-4bea-b44d-486994f4702f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:43.344611 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a0a12726-392a-4bea-b44d-486994f4702f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:43.345190 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a0a12726-392a-4bea-b44d-486994f4702f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:43.346091 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a0a12726-392a-4bea-b44d-486994f4702f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:43.346629 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a0a12726-392a-4bea-b44d-486994f4702f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:43.347050 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a0a12726-392a-4bea-b44d-486994f4702f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:43.406721 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-be1f1b46-2c03-465a-a118-6b6509eafa44 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:43.407422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-be1f1b46-2c03-465a-a118-6b6509eafa44 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:43.414624 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-be1f1b46-2c03-465a-a118-6b6509eafa44 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:43.415432 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-be1f1b46-2c03-465a-a118-6b6509eafa44 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:43.415933 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-be1f1b46-2c03-465a-a118-6b6509eafa44 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:43.416753 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-be1f1b46-2c03-465a-a118-6b6509eafa44 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:43.417271 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-be1f1b46-2c03-465a-a118-6b6509eafa44 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:43.417773 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-be1f1b46-2c03-465a-a118-6b6509eafa44 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:43.419404 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-a0a12726-392a-4bea-b44d-486994f4702f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:43.427419 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-a0a12726-392a-4bea-b44d-486994f4702f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1510 microversion: 2.1 time: 0.095011 Aug 07 22:43:43.428515 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 311/641] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:43 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1510 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:43.559598 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-be1f1b46-2c03-465a-a118-6b6509eafa44 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:43.567031 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-be1f1b46-2c03-465a-a118-6b6509eafa44 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1359 microversion: 2.1 time: 0.164131 Aug 07 22:43:43.567593 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 331/642] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:43 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:43:43.904634 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-88410863-b5de-4f4d-8cd3-57aef3bdb916 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:43.905918 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-88410863-b5de-4f4d-8cd3-57aef3bdb916 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:43.915278 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-88410863-b5de-4f4d-8cd3-57aef3bdb916 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:43.916113 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-88410863-b5de-4f4d-8cd3-57aef3bdb916 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:43.916868 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-88410863-b5de-4f4d-8cd3-57aef3bdb916 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:43.917970 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-88410863-b5de-4f4d-8cd3-57aef3bdb916 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:43.918714 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-88410863-b5de-4f4d-8cd3-57aef3bdb916 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:43.919430 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-88410863-b5de-4f4d-8cd3-57aef3bdb916 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:44.065019 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-88410863-b5de-4f4d-8cd3-57aef3bdb916 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:44.073948 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-88410863-b5de-4f4d-8cd3-57aef3bdb916 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:44.075441 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-88410863-b5de-4f4d-8cd3-57aef3bdb916 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:44.076678 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-88410863-b5de-4f4d-8cd3-57aef3bdb916 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1722 microversion: 2.20 time: 0.180876 Aug 07 22:43:44.077232 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 312/643] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:43 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:44.351013 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-0d7b6707-6519-4c17-b778-bde005ec9166 req-adaefed7-63b1-4bb4-96d7-cdb43222b868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de8d1496-5f71-442d-b1b0-712a7b4f598d", "name": "network-vif-plugged", "status": "completed", "tag": "332a7e9e-deb8-4c55-afbc-6a7faca02b5e"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:43:44.361148 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-0d7b6707-6519-4c17-b778-bde005ec9166 req-adaefed7-63b1-4bb4-96d7-cdb43222b868 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:44.361654 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-0d7b6707-6519-4c17-b778-bde005ec9166 req-adaefed7-63b1-4bb4-96d7-cdb43222b868 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:44.362085 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-0d7b6707-6519-4c17-b778-bde005ec9166 req-adaefed7-63b1-4bb4-96d7-cdb43222b868 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:44.374187 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-0d7b6707-6519-4c17-b778-bde005ec9166 req-adaefed7-63b1-4bb4-96d7-cdb43222b868 service nova] Creating event network-vif-plugged:332a7e9e-deb8-4c55-afbc-6a7faca02b5e for instance de8d1496-5f71-442d-b1b0-712a7b4f598d on hv-cinder-85032 Aug 07 22:43:44.379107 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-0d7b6707-6519-4c17-b778-bde005ec9166 req-adaefed7-63b1-4bb4-96d7-cdb43222b868 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032559 Aug 07 22:43:44.379683 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 332/644] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:43:44.449510 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-12076e82-0078-4fae-be17-4df8d25bf14c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:44.450159 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-12076e82-0078-4fae-be17-4df8d25bf14c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:44.456696 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-12076e82-0078-4fae-be17-4df8d25bf14c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:44.457175 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-12076e82-0078-4fae-be17-4df8d25bf14c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:44.457612 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-12076e82-0078-4fae-be17-4df8d25bf14c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:44.458367 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-12076e82-0078-4fae-be17-4df8d25bf14c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:44.458819 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-12076e82-0078-4fae-be17-4df8d25bf14c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:44.459262 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-12076e82-0078-4fae-be17-4df8d25bf14c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:44.492309 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-12076e82-0078-4fae-be17-4df8d25bf14c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:44.492916 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-12076e82-0078-4fae-be17-4df8d25bf14c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:44.493225 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-12076e82-0078-4fae-be17-4df8d25bf14c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:44.493669 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.objects.instance [None req-12076e82-0078-4fae-be17-4df8d25bf14c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lazy-loading 'fault' on Instance uuid 750b85bc-6bb0-48e2-a912-7664384bcaa0 {{(pid=129965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:43:44.550848 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-12076e82-0078-4fae-be17-4df8d25bf14c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:44.559634 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-12076e82-0078-4fae-be17-4df8d25bf14c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 200 len: 1230 microversion: 2.1 time: 0.114456 Aug 07 22:43:44.560285 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 313/645] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:44 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 1230 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:43:44.589829 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-fba338ab-a910-4aad-84a3-5afc336269ea tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:44.590603 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-fba338ab-a910-4aad-84a3-5afc336269ea tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:44.598246 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fba338ab-a910-4aad-84a3-5afc336269ea tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:44.599300 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fba338ab-a910-4aad-84a3-5afc336269ea tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:44.599747 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fba338ab-a910-4aad-84a3-5afc336269ea tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:44.601543 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fba338ab-a910-4aad-84a3-5afc336269ea tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:44.602180 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fba338ab-a910-4aad-84a3-5afc336269ea tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:44.602637 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fba338ab-a910-4aad-84a3-5afc336269ea tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:45.010048 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-fba338ab-a910-4aad-84a3-5afc336269ea tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:45.028464 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-fba338ab-a910-4aad-84a3-5afc336269ea tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1359 microversion: 2.1 time: 0.444021 Aug 07 22:43:45.029064 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 333/646] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:44 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1359 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:45.102797 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-8d382a08-6695-4266-a2b9-5553ef0e4e84 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:45.108157 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-8d382a08-6695-4266-a2b9-5553ef0e4e84 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:45.111252 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8d382a08-6695-4266-a2b9-5553ef0e4e84 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:45.111993 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8d382a08-6695-4266-a2b9-5553ef0e4e84 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:45.112502 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8d382a08-6695-4266-a2b9-5553ef0e4e84 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:45.113181 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8d382a08-6695-4266-a2b9-5553ef0e4e84 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:45.113681 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8d382a08-6695-4266-a2b9-5553ef0e4e84 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:45.114070 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8d382a08-6695-4266-a2b9-5553ef0e4e84 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:45.247708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8d382a08-6695-4266-a2b9-5553ef0e4e84 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:45.257837 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8d382a08-6695-4266-a2b9-5553ef0e4e84 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:45.259425 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8d382a08-6695-4266-a2b9-5553ef0e4e84 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:45.261057 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-8d382a08-6695-4266-a2b9-5553ef0e4e84 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1665 microversion: 2.20 time: 0.163445 Aug 07 22:43:45.261629 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 314/647] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:45 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1665 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:45.283324 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a9afbfed-df8f-49c1-9835-edb222a32e3d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b48030db-2e5c-4e2a-8804-727b399289e2"}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:43:45.285751 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a9afbfed-df8f-49c1-9835-edb222a32e3d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:45.292961 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a9afbfed-df8f-49c1-9835-edb222a32e3d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:45.297266 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a9afbfed-df8f-49c1-9835-edb222a32e3d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:45.297266 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a9afbfed-df8f-49c1-9835-edb222a32e3d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:45.297266 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a9afbfed-df8f-49c1-9835-edb222a32e3d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:45.297266 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a9afbfed-df8f-49c1-9835-edb222a32e3d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:45.297641 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a9afbfed-df8f-49c1-9835-edb222a32e3d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:45.581494 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-e6d87ecf-9047-4c8b-95df-0ea9479ed4fe tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:45.582402 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-e6d87ecf-9047-4c8b-95df-0ea9479ed4fe tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:45.588845 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e6d87ecf-9047-4c8b-95df-0ea9479ed4fe tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:45.589367 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e6d87ecf-9047-4c8b-95df-0ea9479ed4fe tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:45.589796 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e6d87ecf-9047-4c8b-95df-0ea9479ed4fe tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:45.590479 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e6d87ecf-9047-4c8b-95df-0ea9479ed4fe tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:45.590926 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e6d87ecf-9047-4c8b-95df-0ea9479ed4fe tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:45.591343 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e6d87ecf-9047-4c8b-95df-0ea9479ed4fe tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:45.605104 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.wsgi [None req-e6d87ecf-9047-4c8b-95df-0ea9479ed4fe tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] HTTP exception thrown: Instance 750b85bc-6bb0-48e2-a912-7664384bcaa0 could not be found. Aug 07 22:43:45.606716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-e6d87ecf-9047-4c8b-95df-0ea9479ed4fe tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Request method failure captured: Aug 07 22:43:45.606716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: request: GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 HTTP/1.1 Aug 07 22:43:45.606716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept: application/json Aug 07 22:43:45.606716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept-Encoding: identity Aug 07 22:43:45.606716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Connection: close Aug 07 22:43:45.606716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Length: 0 Aug 07 22:43:45.606716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Type: application/json Aug 07 22:43:45.606716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Host: 10.222.0.30 Aug 07 22:43:45.606716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Openstack-System-Scope: None Aug 07 22:43:45.606716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: User-Agent: python-urllib3/1.26.11 Aug 07 22:43:45.606716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Auth-Token: gAAAAABi8D887V40Peke5jC_QXWsggzAOgLpyxdi_CaERou7vZSymX0hnbt8UkNtFBgypCBm03NmM2Hk6XjJTocxVbaKwu7bOFYcL67tzHVphf3he2hSGQMyJttsp-GmBJmhjsx8BV5Txrap69Svqk9uouGcWuxq6U25k9lCvkPL1Bj8ITc8Mh0 Aug 07 22:43:45.606716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Id: None Aug 07 22:43:45.606716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Name: None Aug 07 22:43:45.606716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Identity-Status: Confirmed Aug 07 22:43:45.606716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Is-Admin-Project: True Aug 07 22:43:45.606716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Id: default Aug 07 22:43:45.606716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Name: Default Aug 07 22:43:45.606716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Id: 6b3cfd456d8748b3a1db990d638340af Aug 07 22:43:45.606716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Name: tempest-TestVolumeBootPattern-2078404334 Aug 07 22:43:45.606716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Role: reader,member Aug 07 22:43:45.606716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Roles: reader,member Aug 07 22:43:45.608291 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6b3cfd456d8748b3a1db990d638340af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6b3cfd456d8748b3a1db990d638340af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6b3cfd456d8748b3a1db990d638340af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6b3cfd456d8748b3a1db990d638340af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:43:45.608291 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant: tempest-TestVolumeBootPattern-2078404334 Aug 07 22:43:45.608291 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Id: 6b3cfd456d8748b3a1db990d638340af Aug 07 22:43:45.608291 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Name: tempest-TestVolumeBootPattern-2078404334 Aug 07 22:43:45.608291 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User: tempest-TestVolumeBootPattern-2078404334-project Aug 07 22:43:45.608291 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Id: default Aug 07 22:43:45.608291 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Name: Default Aug 07 22:43:45.608291 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Id: 394c67bcc3864bb2aca2f4faec834029 Aug 07 22:43:45.608291 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Name: tempest-TestVolumeBootPattern-2078404334-project Aug 07 22:43:45.608291 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: method: > Aug 07 22:43:45.608291 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: exception: Instance 750b85bc-6bb0-48e2-a912-7664384bcaa0 could not be found. Aug 07 22:43:45.608291 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: action_args: {'id': '750b85bc-6bb0-48e2-a912-7664384bcaa0'} Aug 07 22:43:45.609100 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:43:45.609100 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:43:45.609100 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:43:45.609100 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:43:45.609100 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:43:45.609100 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:43:45.609100 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:43:45.609100 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:43:45.609100 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:43:45.609100 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:43:45.609100 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 750b85bc-6bb0-48e2-a912-7664384bcaa0 could not be found. Aug 07 22:43:45.609100 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:43:45.609100 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:43:45.609100 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:43:45.609100 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:43:45.609100 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:43:45.609100 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:43:45.609100 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:43:45.609100 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:43:45.609100 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:43:45.610582 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:43:45.610582 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:43:45.610582 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:43:45.610582 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:43:45.610582 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:43:45.610582 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:43:45.610582 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:43:45.610582 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 750b85bc-6bb0-48e2-a912-7664384bcaa0 could not be found. Aug 07 22:43:45.610582 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:43:45.610582 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:43:45.610582 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:43:45.610582 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:43:45.610582 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:43:45.610582 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:43:45.610582 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:43:45.610582 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:43:45.610582 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 750b85bc-6bb0-48e2-a912-7664384bcaa0 could not be found. Aug 07 22:43:45.610582 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:43:45.611902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-e6d87ecf-9047-4c8b-95df-0ea9479ed4fe tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Returning 404 to user: Instance 750b85bc-6bb0-48e2-a912-7664384bcaa0 could not be found. {{(pid=129965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:43:45.611902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-e6d87ecf-9047-4c8b-95df-0ea9479ed4fe tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 404 len: 111 microversion: 2.1 time: 0.030699 Aug 07 22:43:45.611902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 315/648] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:45 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 22:43:45.707689 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-9d85d6e3-f0e6-4f72-a8ff-2dd0944b32ef tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2019488543", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-754102463", "security_groups": [{"name": "tempest-secgroup-smoke-1868642240"}], "block_device_mapping_v2": [{"uuid": "8987e5d9-1877-4789-9cfd-bd3647af27bd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aaf0b534-ba14-4766-8d78-28b21425ddb7"}]}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:43:45.836707 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.network.neutron [None req-9d85d6e3-f0e6-4f72-a8ff-2dd0944b32ef tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] validate_networks() for [('aaf0b534-ba14-4766-8d78-28b21425ddb7', None, None, None, None, None)] {{(pid=129965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 22:43:46.295580 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a9afbfed-df8f-49c1-9835-edb222a32e3d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "POST /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.016103 Aug 07 22:43:46.301490 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 334/649] 10.222.0.30 () {62 vars in 1364 bytes} [Sun Aug 7 22:43:45 2022] POST /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99/os-volume_attachments => generated 188 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 22:43:46.301490 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-bc02e8cd-eca0-46ee-a88e-bd3810b656e9 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:46.302477 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-bc02e8cd-eca0-46ee-a88e-bd3810b656e9 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:46.309930 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bc02e8cd-eca0-46ee-a88e-bd3810b656e9 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:46.310489 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bc02e8cd-eca0-46ee-a88e-bd3810b656e9 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:46.311126 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bc02e8cd-eca0-46ee-a88e-bd3810b656e9 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:46.311842 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bc02e8cd-eca0-46ee-a88e-bd3810b656e9 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:46.312455 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bc02e8cd-eca0-46ee-a88e-bd3810b656e9 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:46.312893 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bc02e8cd-eca0-46ee-a88e-bd3810b656e9 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:46.325535 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-9d85d6e3-f0e6-4f72-a8ff-2dd0944b32ef tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Flavor limits 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 22:43:46.325922 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-9d85d6e3-f0e6-4f72-a8ff-2dd0944b32ef tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Image limits 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 22:43:46.330407 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-9d85d6e3-f0e6-4f72-a8ff-2dd0944b32ef tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Flavor pref 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 22:43:46.330407 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-9d85d6e3-f0e6-4f72-a8ff-2dd0944b32ef tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Image pref 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 22:43:46.330407 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-9d85d6e3-f0e6-4f72-a8ff-2dd0944b32ef tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 22:43:46.337758 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9d85d6e3-f0e6-4f72-a8ff-2dd0944b32ef tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:46.338240 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9d85d6e3-f0e6-4f72-a8ff-2dd0944b32ef tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:46.338738 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9d85d6e3-f0e6-4f72-a8ff-2dd0944b32ef tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:46.339693 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9d85d6e3-f0e6-4f72-a8ff-2dd0944b32ef tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:46.340278 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9d85d6e3-f0e6-4f72-a8ff-2dd0944b32ef tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:46.340954 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9d85d6e3-f0e6-4f72-a8ff-2dd0944b32ef tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:46.361707 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-9d85d6e3-f0e6-4f72-a8ff-2dd0944b32ef tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Getting quotas for project 6b3cfd456d8748b3a1db990d638340af. Resources: {'cores', 'instances', 'ram'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:43:46.364920 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-9d85d6e3-f0e6-4f72-a8ff-2dd0944b32ef tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Getting quotas for user 394c67bcc3864bb2aca2f4faec834029 and project 6b3cfd456d8748b3a1db990d638340af. Resources: {'cores', 'instances', 'ram'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:43:46.440699 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-9d85d6e3-f0e6-4f72-a8ff-2dd0944b32ef tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Going to run 1 instances... {{(pid=129965) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 22:43:46.442826 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-9d85d6e3-f0e6-4f72-a8ff-2dd0944b32ef tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8987e5d9-1877-4789-9cfd-bd3647af27bd',volume_size=None,volume_type=None)] {{(pid=129965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 22:43:46.464589 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-bc02e8cd-eca0-46ee-a88e-bd3810b656e9 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:46.472331 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-bc02e8cd-eca0-46ee-a88e-bd3810b656e9 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1359 microversion: 2.1 time: 0.174995 Aug 07 22:43:46.472996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 335/650] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:46 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:46.478176 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-c6964f54-831a-41ca-b798-d77bdc71042c req-abdcc255-6ed5-4392-8120-148a67cfab74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cef2464-0337-4fbd-a727-a24160f14f99", "name": "network-vif-unplugged", "status": "completed", "tag": "28f8e101-7a4a-4833-b344-83657618e970"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:43:46.489314 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-c6964f54-831a-41ca-b798-d77bdc71042c req-abdcc255-6ed5-4392-8120-148a67cfab74 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:46.489793 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-c6964f54-831a-41ca-b798-d77bdc71042c req-abdcc255-6ed5-4392-8120-148a67cfab74 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:46.490227 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-c6964f54-831a-41ca-b798-d77bdc71042c req-abdcc255-6ed5-4392-8120-148a67cfab74 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:46.501952 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.compute.server_external_events [req-c6964f54-831a-41ca-b798-d77bdc71042c req-abdcc255-6ed5-4392-8120-148a67cfab74 service nova] Unable to find a host for instance 9cef2464-0337-4fbd-a727-a24160f14f99. Dropping event network-vif-unplugged {{(pid=129964) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 07 22:43:46.502908 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-c6964f54-831a-41ca-b798-d77bdc71042c req-abdcc255-6ed5-4392-8120-148a67cfab74 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028726 Aug 07 22:43:46.503503 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 336/651] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 07 22:43:46.508952 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-549b540c-6b95-45c1-9730-f591bab5d157 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:46.509448 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-549b540c-6b95-45c1-9730-f591bab5d157 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:46.515939 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-549b540c-6b95-45c1-9730-f591bab5d157 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:46.520607 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-549b540c-6b95-45c1-9730-f591bab5d157 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:46.520607 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-549b540c-6b95-45c1-9730-f591bab5d157 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:46.520607 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-549b540c-6b95-45c1-9730-f591bab5d157 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:46.520607 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-549b540c-6b95-45c1-9730-f591bab5d157 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:46.520951 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-549b540c-6b95-45c1-9730-f591bab5d157 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:46.525995 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:46.796919 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-9d85d6e3-f0e6-4f72-a8ff-2dd0944b32ef tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.093100 Aug 07 22:43:46.797563 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 316/652] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 22:43:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 22:43:46.813391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d086b5bd-e27d-4c57-8fb8-1ec8db2af893 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:46.813391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-d086b5bd-e27d-4c57-8fb8-1ec8db2af893 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:46.878027 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-d086b5bd-e27d-4c57-8fb8-1ec8db2af893 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:46.885241 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-d086b5bd-e27d-4c57-8fb8-1ec8db2af893 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1094 microversion: 2.1 time: 0.080169 Aug 07 22:43:46.886665 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 317/653] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:46 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:43:47.086000 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-549b540c-6b95-45c1-9730-f591bab5d157 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99/os-volume_attachments/b48030db-2e5c-4e2a-8804-727b399289e2" status: 202 len: 0 microversion: 2.20 time: 0.580914 Aug 07 22:43:47.088915 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 337/654] 10.222.0.30 () {60 vars in 1457 bytes} [Sun Aug 7 22:43:46 2022] DELETE /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99/os-volume_attachments/b48030db-2e5c-4e2a-8804-727b399289e2 => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 22:43:47.155551 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-1a35b4de-1881-4edf-8b1e-341bbd96581c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:43:47.156193 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-1a35b4de-1881-4edf-8b1e-341bbd96581c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:47.162295 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1a35b4de-1881-4edf-8b1e-341bbd96581c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:47.162776 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1a35b4de-1881-4edf-8b1e-341bbd96581c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:47.164038 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1a35b4de-1881-4edf-8b1e-341bbd96581c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:47.164862 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1a35b4de-1881-4edf-8b1e-341bbd96581c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:47.165315 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1a35b4de-1881-4edf-8b1e-341bbd96581c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:47.165748 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1a35b4de-1881-4edf-8b1e-341bbd96581c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:47.169571 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=100 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:47.211159 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-1a35b4de-1881-4edf-8b1e-341bbd96581c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129965) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 07 22:43:47.493238 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-54c4fc07-cc7f-4c06-9b45-a76bd1749f61 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:47.493849 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-1a35b4de-1881-4edf-8b1e-341bbd96581c tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "POST /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99/action" status: 202 len: 0 microversion: 2.20 time: 0.342304 Aug 07 22:43:47.494051 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-54c4fc07-cc7f-4c06-9b45-a76bd1749f61 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:47.494674 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 318/655] 10.222.0.30 () {62 vars in 1319 bytes} [Sun Aug 7 22:43:47 2022] POST /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 22:43:47.500947 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-54c4fc07-cc7f-4c06-9b45-a76bd1749f61 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:47.502631 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-8b641c47-08a4-4a53-b607-f4382b652aee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:47.503475 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-8b641c47-08a4-4a53-b607-f4382b652aee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:47.505123 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-54c4fc07-cc7f-4c06-9b45-a76bd1749f61 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:47.506033 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-54c4fc07-cc7f-4c06-9b45-a76bd1749f61 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:47.507537 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-54c4fc07-cc7f-4c06-9b45-a76bd1749f61 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:47.508435 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-54c4fc07-cc7f-4c06-9b45-a76bd1749f61 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:47.509224 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-54c4fc07-cc7f-4c06-9b45-a76bd1749f61 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:47.511702 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8b641c47-08a4-4a53-b607-f4382b652aee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:47.512613 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8b641c47-08a4-4a53-b607-f4382b652aee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:47.518120 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8b641c47-08a4-4a53-b607-f4382b652aee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:47.518120 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8b641c47-08a4-4a53-b607-f4382b652aee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:47.518120 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8b641c47-08a4-4a53-b607-f4382b652aee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:47.518120 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8b641c47-08a4-4a53-b607-f4382b652aee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:47.721832 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-54c4fc07-cc7f-4c06-9b45-a76bd1749f61 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:47.728448 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8b641c47-08a4-4a53-b607-f4382b652aee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:47.733130 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-54c4fc07-cc7f-4c06-9b45-a76bd1749f61 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1548 microversion: 2.1 time: 0.243738 Aug 07 22:43:47.733722 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 338/656] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:47 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1548 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:43:47.737899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8b641c47-08a4-4a53-b607-f4382b652aee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:47.739542 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8b641c47-08a4-4a53-b607-f4382b652aee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:47.740823 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-8b641c47-08a4-4a53-b607-f4382b652aee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1673 microversion: 2.20 time: 0.242007 Aug 07 22:43:47.741564 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 319/657] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:47 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1673 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:43:47.754523 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-43f48766-268a-4db8-98cb-d415d9e487b6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:47.755753 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-43f48766-268a-4db8-98cb-d415d9e487b6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:47.763090 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-43f48766-268a-4db8-98cb-d415d9e487b6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:47.763578 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-43f48766-268a-4db8-98cb-d415d9e487b6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:47.764033 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-43f48766-268a-4db8-98cb-d415d9e487b6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:47.764846 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-43f48766-268a-4db8-98cb-d415d9e487b6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:47.765432 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-43f48766-268a-4db8-98cb-d415d9e487b6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:47.765862 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-43f48766-268a-4db8-98cb-d415d9e487b6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:47.906595 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-2fe95411-80cf-4f80-8a26-62efb979bc88 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:47.907244 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-2fe95411-80cf-4f80-8a26-62efb979bc88 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:47.907454 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-43f48766-268a-4db8-98cb-d415d9e487b6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:47.913611 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2fe95411-80cf-4f80-8a26-62efb979bc88 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:47.921830 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2fe95411-80cf-4f80-8a26-62efb979bc88 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:47.921830 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2fe95411-80cf-4f80-8a26-62efb979bc88 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:47.921830 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2fe95411-80cf-4f80-8a26-62efb979bc88 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:47.921830 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2fe95411-80cf-4f80-8a26-62efb979bc88 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:47.922266 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-43f48766-268a-4db8-98cb-d415d9e487b6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1548 microversion: 2.1 time: 0.165332 Aug 07 22:43:47.922378 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2fe95411-80cf-4f80-8a26-62efb979bc88 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:47.922471 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 339/658] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:47 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:47.937009 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-06acb389-c40d-4859-bdab-b16867e722ba tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:47.950815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-06acb389-c40d-4859-bdab-b16867e722ba tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:47.951724 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-06acb389-c40d-4859-bdab-b16867e722ba tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Searching by: {'deleted': False, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca'} {{(pid=129964) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 22:43:47.971835 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-06acb389-c40d-4859-bdab-b16867e722ba tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:47.976744 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-06acb389-c40d-4859-bdab-b16867e722ba tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:47.977323 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-06acb389-c40d-4859-bdab-b16867e722ba tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:47.982035 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-06acb389-c40d-4859-bdab-b16867e722ba tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:47.986813 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-06acb389-c40d-4859-bdab-b16867e722ba tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:47.987542 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-06acb389-c40d-4859-bdab-b16867e722ba tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:48.015054 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-2fe95411-80cf-4f80-8a26-62efb979bc88 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:48.024784 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-2fe95411-80cf-4f80-8a26-62efb979bc88 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1144 microversion: 2.1 time: 0.122485 Aug 07 22:43:48.026976 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 320/659] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:47 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1144 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:48.091723 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.multi_cell_list [None req-06acb389-c40d-4859-bdab-b16867e722ba tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129964) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 22:43:48.194290 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-06acb389-c40d-4859-bdab-b16867e722ba tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.261533 Aug 07 22:43:48.195829 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 340/660] 10.222.0.30 () {58 vars in 1125 bytes} [Sun Aug 7 22:43:47 2022] GET /compute/v2.1/servers => generated 343 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:43:48.212792 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-311c422c-3cfb-46a5-b654-d97648638ab7 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:48.213488 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-311c422c-3cfb-46a5-b654-d97648638ab7 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:48.219889 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-311c422c-3cfb-46a5-b654-d97648638ab7 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:48.220642 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-311c422c-3cfb-46a5-b654-d97648638ab7 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:48.221021 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-311c422c-3cfb-46a5-b654-d97648638ab7 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:48.221920 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-311c422c-3cfb-46a5-b654-d97648638ab7 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:48.222465 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-311c422c-3cfb-46a5-b654-d97648638ab7 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:48.222965 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-311c422c-3cfb-46a5-b654-d97648638ab7 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:48.379800 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-311c422c-3cfb-46a5-b654-d97648638ab7 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:48.387959 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-311c422c-3cfb-46a5-b654-d97648638ab7 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1548 microversion: 2.1 time: 0.179322 Aug 07 22:43:48.388622 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 321/661] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:48 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1548 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:48.442058 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-1d0201f2-0ab6-4732-825a-553526bcef15 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:43:48.442931 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-1d0201f2-0ab6-4732-825a-553526bcef15 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:48.450367 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1d0201f2-0ab6-4732-825a-553526bcef15 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:48.450935 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1d0201f2-0ab6-4732-825a-553526bcef15 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:48.451671 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1d0201f2-0ab6-4732-825a-553526bcef15 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:48.452405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1d0201f2-0ab6-4732-825a-553526bcef15 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:48.453145 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1d0201f2-0ab6-4732-825a-553526bcef15 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:48.453439 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1d0201f2-0ab6-4732-825a-553526bcef15 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:48.479661 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.objects.instance [None req-1d0201f2-0ab6-4732-825a-553526bcef15 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lazy-loading 'flavor' on Instance uuid 93991d13-4c43-4e03-9031-2d5032989994 {{(pid=129964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:43:48.764770 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-5074bcbf-8f6e-4a75-99d9-2d65a1362240 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:48.769276 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-5074bcbf-8f6e-4a75-99d9-2d65a1362240 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:48.772225 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5074bcbf-8f6e-4a75-99d9-2d65a1362240 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:48.773761 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5074bcbf-8f6e-4a75-99d9-2d65a1362240 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:48.774199 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5074bcbf-8f6e-4a75-99d9-2d65a1362240 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:48.775427 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5074bcbf-8f6e-4a75-99d9-2d65a1362240 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:48.775886 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5074bcbf-8f6e-4a75-99d9-2d65a1362240 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:48.776499 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5074bcbf-8f6e-4a75-99d9-2d65a1362240 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:48.799301 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-1d0201f2-0ab6-4732-825a-553526bcef15 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "POST /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994/action" status: 202 len: 0 microversion: 2.1 time: 0.361055 Aug 07 22:43:48.799943 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 341/662] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 22:43:48 2022] POST /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:43:48.808478 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-379dae02-e481-4e5d-8d00-6b8d81e5d1a5 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:48.809178 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-379dae02-e481-4e5d-8d00-6b8d81e5d1a5 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:48.815562 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-379dae02-e481-4e5d-8d00-6b8d81e5d1a5 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:48.816072 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-379dae02-e481-4e5d-8d00-6b8d81e5d1a5 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:48.816517 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-379dae02-e481-4e5d-8d00-6b8d81e5d1a5 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:48.817231 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-379dae02-e481-4e5d-8d00-6b8d81e5d1a5 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:48.817680 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-379dae02-e481-4e5d-8d00-6b8d81e5d1a5 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:48.818098 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-379dae02-e481-4e5d-8d00-6b8d81e5d1a5 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:49.020524 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-5074bcbf-8f6e-4a75-99d9-2d65a1362240 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:49.030343 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-5074bcbf-8f6e-4a75-99d9-2d65a1362240 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:49.032249 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-5074bcbf-8f6e-4a75-99d9-2d65a1362240 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:49.033429 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-5074bcbf-8f6e-4a75-99d9-2d65a1362240 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1673 microversion: 2.20 time: 0.272912 Aug 07 22:43:49.037441 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 322/663] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:48 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1673 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:43:49.057592 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-fad22ba5-5e8a-4574-a3b9-1eadef9dd21c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:49.060147 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-fad22ba5-5e8a-4574-a3b9-1eadef9dd21c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:49.065287 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fad22ba5-5e8a-4574-a3b9-1eadef9dd21c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:49.066044 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fad22ba5-5e8a-4574-a3b9-1eadef9dd21c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:49.066717 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fad22ba5-5e8a-4574-a3b9-1eadef9dd21c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:49.067643 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fad22ba5-5e8a-4574-a3b9-1eadef9dd21c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:49.068355 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fad22ba5-5e8a-4574-a3b9-1eadef9dd21c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:49.069011 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fad22ba5-5e8a-4574-a3b9-1eadef9dd21c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:49.091149 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-379dae02-e481-4e5d-8d00-6b8d81e5d1a5 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:49.108316 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-379dae02-e481-4e5d-8d00-6b8d81e5d1a5 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1570 microversion: 2.1 time: 0.303789 Aug 07 22:43:49.108900 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 342/664] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:48 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1570 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:43:49.179913 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-fad22ba5-5e8a-4574-a3b9-1eadef9dd21c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:49.188844 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-fad22ba5-5e8a-4574-a3b9-1eadef9dd21c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1200 microversion: 2.1 time: 0.136022 Aug 07 22:43:49.189618 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 323/665] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:49 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1200 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:50.060512 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-7b51b7fe-4faa-466a-b7d6-39bca45efb6e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:50.062054 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-7b51b7fe-4faa-466a-b7d6-39bca45efb6e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:50.070160 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7b51b7fe-4faa-466a-b7d6-39bca45efb6e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:50.070937 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7b51b7fe-4faa-466a-b7d6-39bca45efb6e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:50.071781 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7b51b7fe-4faa-466a-b7d6-39bca45efb6e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:50.073071 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7b51b7fe-4faa-466a-b7d6-39bca45efb6e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:50.073680 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7b51b7fe-4faa-466a-b7d6-39bca45efb6e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:50.074253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7b51b7fe-4faa-466a-b7d6-39bca45efb6e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:50.130571 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-51c5f5c9-4b8b-4c60-80ec-f3d2ea7c8b4c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:50.131139 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-51c5f5c9-4b8b-4c60-80ec-f3d2ea7c8b4c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:50.155013 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-51c5f5c9-4b8b-4c60-80ec-f3d2ea7c8b4c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:50.155519 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-51c5f5c9-4b8b-4c60-80ec-f3d2ea7c8b4c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:50.155957 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-51c5f5c9-4b8b-4c60-80ec-f3d2ea7c8b4c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:50.156678 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-51c5f5c9-4b8b-4c60-80ec-f3d2ea7c8b4c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:50.157131 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-51c5f5c9-4b8b-4c60-80ec-f3d2ea7c8b4c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:50.157554 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-51c5f5c9-4b8b-4c60-80ec-f3d2ea7c8b4c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:50.336916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-7b51b7fe-4faa-466a-b7d6-39bca45efb6e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:50.341881 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-7b51b7fe-4faa-466a-b7d6-39bca45efb6e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:50.343350 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-7b51b7fe-4faa-466a-b7d6-39bca45efb6e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:50.350410 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-7b51b7fe-4faa-466a-b7d6-39bca45efb6e tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1731 microversion: 2.20 time: 0.294150 Aug 07 22:43:50.351817 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 343/666] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:50 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1731 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:50.372875 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-652468dd-12fe-4c17-a90e-6bcc5dacb6b5 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:50.373768 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-652468dd-12fe-4c17-a90e-6bcc5dacb6b5 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:50.380511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-652468dd-12fe-4c17-a90e-6bcc5dacb6b5 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:50.381294 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-652468dd-12fe-4c17-a90e-6bcc5dacb6b5 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:50.381930 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-652468dd-12fe-4c17-a90e-6bcc5dacb6b5 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:50.382799 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-652468dd-12fe-4c17-a90e-6bcc5dacb6b5 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:50.383413 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-652468dd-12fe-4c17-a90e-6bcc5dacb6b5 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:50.383994 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-652468dd-12fe-4c17-a90e-6bcc5dacb6b5 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:50.604332 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-51c5f5c9-4b8b-4c60-80ec-f3d2ea7c8b4c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:50.613690 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-51c5f5c9-4b8b-4c60-80ec-f3d2ea7c8b4c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1570 microversion: 2.1 time: 0.486438 Aug 07 22:43:50.628530 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 324/667] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:50 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1570 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:50.634457 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-fd2cefae-c0a9-41b4-9d55-551072436759 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1534df5c-a575-427b-84ef-ecc7689a9034"}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:43:50.637443 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-fd2cefae-c0a9-41b4-9d55-551072436759 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:50.643862 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fd2cefae-c0a9-41b4-9d55-551072436759 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:50.644446 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fd2cefae-c0a9-41b4-9d55-551072436759 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:50.645141 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fd2cefae-c0a9-41b4-9d55-551072436759 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:50.645911 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fd2cefae-c0a9-41b4-9d55-551072436759 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:50.646562 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fd2cefae-c0a9-41b4-9d55-551072436759 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:50.647182 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fd2cefae-c0a9-41b4-9d55-551072436759 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:50.655034 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-652468dd-12fe-4c17-a90e-6bcc5dacb6b5 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:50.670028 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-652468dd-12fe-4c17-a90e-6bcc5dacb6b5 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1278 microversion: 2.1 time: 0.304454 Aug 07 22:43:50.670620 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 344/668] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:50 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1278 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:51.081827 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-0a52746b-0837-4f34-84d9-9d0497b62665 req-e2bf07c3-63e5-49c2-8a6a-f849dbe4b3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38", "tag": "62940318-36f5-4e66-8a0a-be8fade04295"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:43:51.093945 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-0a52746b-0837-4f34-84d9-9d0497b62665 req-e2bf07c3-63e5-49c2-8a6a-f849dbe4b3a9 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:51.101341 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-0a52746b-0837-4f34-84d9-9d0497b62665 req-e2bf07c3-63e5-49c2-8a6a-f849dbe4b3a9 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:51.101341 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-0a52746b-0837-4f34-84d9-9d0497b62665 req-e2bf07c3-63e5-49c2-8a6a-f849dbe4b3a9 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:51.106976 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-0a52746b-0837-4f34-84d9-9d0497b62665 req-e2bf07c3-63e5-49c2-8a6a-f849dbe4b3a9 service nova] Creating event network-changed:62940318-36f5-4e66-8a0a-be8fade04295 for instance d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 on hv-cinder-85032 Aug 07 22:43:51.115063 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-0a52746b-0837-4f34-84d9-9d0497b62665 req-e2bf07c3-63e5-49c2-8a6a-f849dbe4b3a9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037620 Aug 07 22:43:51.115724 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 345/669] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:43:51.380293 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-2c842a52-8149-47e1-880e-9fe9f0d78462 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:51.381152 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-2c842a52-8149-47e1-880e-9fe9f0d78462 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:51.388986 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2c842a52-8149-47e1-880e-9fe9f0d78462 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:51.389722 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2c842a52-8149-47e1-880e-9fe9f0d78462 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:51.390156 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2c842a52-8149-47e1-880e-9fe9f0d78462 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:51.390852 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2c842a52-8149-47e1-880e-9fe9f0d78462 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:51.391290 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2c842a52-8149-47e1-880e-9fe9f0d78462 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:51.391877 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2c842a52-8149-47e1-880e-9fe9f0d78462 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:51.489536 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-fd2cefae-c0a9-41b4-9d55-551072436759 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "POST /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.859448 Aug 07 22:43:51.490248 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 325/670] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 22:43:50 2022] POST /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d/os-volume_attachments => generated 194 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:43:51.550136 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-2c842a52-8149-47e1-880e-9fe9f0d78462 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:51.559692 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-2c842a52-8149-47e1-880e-9fe9f0d78462 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:51.561525 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-2c842a52-8149-47e1-880e-9fe9f0d78462 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:51.562893 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-2c842a52-8149-47e1-880e-9fe9f0d78462 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1731 microversion: 2.20 time: 0.188405 Aug 07 22:43:51.563761 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 346/671] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:51 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:51.635567 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-5a0111c9-5773-41e9-800d-df323f6f729c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:51.636489 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-5a0111c9-5773-41e9-800d-df323f6f729c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:51.643368 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5a0111c9-5773-41e9-800d-df323f6f729c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:51.644192 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5a0111c9-5773-41e9-800d-df323f6f729c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:51.644721 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5a0111c9-5773-41e9-800d-df323f6f729c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:51.645375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5a0111c9-5773-41e9-800d-df323f6f729c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:51.645809 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5a0111c9-5773-41e9-800d-df323f6f729c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:51.646238 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5a0111c9-5773-41e9-800d-df323f6f729c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:51.695251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-c1b85afb-6f8d-454f-a25d-5185295bbe08 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:51.695959 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-c1b85afb-6f8d-454f-a25d-5185295bbe08 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:51.710371 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c1b85afb-6f8d-454f-a25d-5185295bbe08 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:51.720689 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c1b85afb-6f8d-454f-a25d-5185295bbe08 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:51.721600 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c1b85afb-6f8d-454f-a25d-5185295bbe08 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:51.722594 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c1b85afb-6f8d-454f-a25d-5185295bbe08 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:51.723154 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c1b85afb-6f8d-454f-a25d-5185295bbe08 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:51.723692 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c1b85afb-6f8d-454f-a25d-5185295bbe08 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:51.909884 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-5a0111c9-5773-41e9-800d-df323f6f729c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:51.926297 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-5a0111c9-5773-41e9-800d-df323f6f729c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1570 microversion: 2.1 time: 0.295106 Aug 07 22:43:51.926927 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 326/672] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:51 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1570 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:52.013554 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-c1b85afb-6f8d-454f-a25d-5185295bbe08 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:52.029455 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-c1b85afb-6f8d-454f-a25d-5185295bbe08 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1266 microversion: 2.1 time: 0.338675 Aug 07 22:43:52.040491 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 347/673] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:51 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1266 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:52.590029 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-499d5f3d-a8be-44db-a368-e09592cf6414 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:52.590811 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-499d5f3d-a8be-44db-a368-e09592cf6414 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:52.603021 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-499d5f3d-a8be-44db-a368-e09592cf6414 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:52.603973 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-499d5f3d-a8be-44db-a368-e09592cf6414 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:52.604942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-499d5f3d-a8be-44db-a368-e09592cf6414 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:52.606126 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-499d5f3d-a8be-44db-a368-e09592cf6414 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:52.606828 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-499d5f3d-a8be-44db-a368-e09592cf6414 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:52.607588 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-499d5f3d-a8be-44db-a368-e09592cf6414 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:52.770345 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-499d5f3d-a8be-44db-a368-e09592cf6414 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:52.780438 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-499d5f3d-a8be-44db-a368-e09592cf6414 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:52.781967 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-499d5f3d-a8be-44db-a368-e09592cf6414 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:52.783120 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-499d5f3d-a8be-44db-a368-e09592cf6414 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1731 microversion: 2.20 time: 0.197113 Aug 07 22:43:52.783674 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 327/674] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:52 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1731 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:52.947307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b8bc7be1-5a73-47f8-bed1-e47fda131e44 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:52.947902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-b8bc7be1-5a73-47f8-bed1-e47fda131e44 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:52.954396 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b8bc7be1-5a73-47f8-bed1-e47fda131e44 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:52.954869 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b8bc7be1-5a73-47f8-bed1-e47fda131e44 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:52.955297 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b8bc7be1-5a73-47f8-bed1-e47fda131e44 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:52.955983 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b8bc7be1-5a73-47f8-bed1-e47fda131e44 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:52.956451 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b8bc7be1-5a73-47f8-bed1-e47fda131e44 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:52.956862 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b8bc7be1-5a73-47f8-bed1-e47fda131e44 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:53.061397 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-046b0d3a-ef52-40fd-bce2-4e0fd975e313 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:53.062541 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-046b0d3a-ef52-40fd-bce2-4e0fd975e313 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:53.070772 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-046b0d3a-ef52-40fd-bce2-4e0fd975e313 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:53.072358 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-046b0d3a-ef52-40fd-bce2-4e0fd975e313 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:53.072843 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-046b0d3a-ef52-40fd-bce2-4e0fd975e313 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:53.073582 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-046b0d3a-ef52-40fd-bce2-4e0fd975e313 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:53.074057 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-046b0d3a-ef52-40fd-bce2-4e0fd975e313 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:53.074502 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-046b0d3a-ef52-40fd-bce2-4e0fd975e313 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:53.142965 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-b8bc7be1-5a73-47f8-bed1-e47fda131e44 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:53.155193 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-b8bc7be1-5a73-47f8-bed1-e47fda131e44 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1570 microversion: 2.1 time: 0.212105 Aug 07 22:43:53.155756 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 348/675] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:52 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1570 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:53.236626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-046b0d3a-ef52-40fd-bce2-4e0fd975e313 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:53.244701 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-046b0d3a-ef52-40fd-bce2-4e0fd975e313 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1266 microversion: 2.1 time: 0.187160 Aug 07 22:43:53.245275 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 328/676] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:53 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:43:53.808156 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f786f305-8ff5-4a06-9672-4a7e26832cee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:53.809088 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f786f305-8ff5-4a06-9672-4a7e26832cee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:53.816058 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f786f305-8ff5-4a06-9672-4a7e26832cee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:53.816660 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f786f305-8ff5-4a06-9672-4a7e26832cee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:53.817200 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f786f305-8ff5-4a06-9672-4a7e26832cee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:53.817935 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f786f305-8ff5-4a06-9672-4a7e26832cee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:53.818391 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f786f305-8ff5-4a06-9672-4a7e26832cee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:53.818817 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f786f305-8ff5-4a06-9672-4a7e26832cee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:53.838593 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:53.963824 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f786f305-8ff5-4a06-9672-4a7e26832cee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:53.969163 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f786f305-8ff5-4a06-9672-4a7e26832cee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:53.970772 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f786f305-8ff5-4a06-9672-4a7e26832cee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:53.976852 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f786f305-8ff5-4a06-9672-4a7e26832cee tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1731 microversion: 2.20 time: 0.173695 Aug 07 22:43:53.977801 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 349/677] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:53 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:43:54.178870 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-e73700a5-0f19-41df-84af-a06fa3985f31 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:54.179676 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-e73700a5-0f19-41df-84af-a06fa3985f31 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:54.186456 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e73700a5-0f19-41df-84af-a06fa3985f31 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:54.186896 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e73700a5-0f19-41df-84af-a06fa3985f31 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:54.187334 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e73700a5-0f19-41df-84af-a06fa3985f31 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:54.188071 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e73700a5-0f19-41df-84af-a06fa3985f31 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:54.188529 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e73700a5-0f19-41df-84af-a06fa3985f31 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:54.188956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e73700a5-0f19-41df-84af-a06fa3985f31 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:54.268341 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-cfb1d17e-ebf2-44a9-a21d-cf08f59bab21 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:54.269044 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-cfb1d17e-ebf2-44a9-a21d-cf08f59bab21 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:54.279741 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cfb1d17e-ebf2-44a9-a21d-cf08f59bab21 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:54.280604 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cfb1d17e-ebf2-44a9-a21d-cf08f59bab21 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:54.281240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cfb1d17e-ebf2-44a9-a21d-cf08f59bab21 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:54.282300 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cfb1d17e-ebf2-44a9-a21d-cf08f59bab21 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:54.283264 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cfb1d17e-ebf2-44a9-a21d-cf08f59bab21 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:54.283989 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cfb1d17e-ebf2-44a9-a21d-cf08f59bab21 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:54.471072 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-e73700a5-0f19-41df-84af-a06fa3985f31 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:54.488377 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-e73700a5-0f19-41df-84af-a06fa3985f31 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1570 microversion: 2.1 time: 0.313859 Aug 07 22:43:54.489251 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 329/678] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:54 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1570 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:54.502851 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-cfb1d17e-ebf2-44a9-a21d-cf08f59bab21 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:54.511970 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-cfb1d17e-ebf2-44a9-a21d-cf08f59bab21 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1266 microversion: 2.1 time: 0.250271 Aug 07 22:43:54.512999 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 350/679] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:54 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:54.999720 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-597a35d7-dd5b-4fe3-8613-5f0cba9c9ab8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:55.000275 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-597a35d7-dd5b-4fe3-8613-5f0cba9c9ab8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:55.007188 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-597a35d7-dd5b-4fe3-8613-5f0cba9c9ab8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:55.007833 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-597a35d7-dd5b-4fe3-8613-5f0cba9c9ab8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:55.008236 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-597a35d7-dd5b-4fe3-8613-5f0cba9c9ab8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:55.008952 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-597a35d7-dd5b-4fe3-8613-5f0cba9c9ab8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:55.009420 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-597a35d7-dd5b-4fe3-8613-5f0cba9c9ab8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:55.009957 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-597a35d7-dd5b-4fe3-8613-5f0cba9c9ab8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:55.164672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-597a35d7-dd5b-4fe3-8613-5f0cba9c9ab8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:55.173093 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-597a35d7-dd5b-4fe3-8613-5f0cba9c9ab8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:55.174625 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-597a35d7-dd5b-4fe3-8613-5f0cba9c9ab8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:55.175804 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-597a35d7-dd5b-4fe3-8613-5f0cba9c9ab8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1731 microversion: 2.20 time: 0.180004 Aug 07 22:43:55.176572 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 330/680] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:54 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:55.531868 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-84edda2a-58f2-4cf2-9cb7-4f97a3c8578b tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:55.532536 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-84edda2a-58f2-4cf2-9cb7-4f97a3c8578b tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:55.533823 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-a8e180f4-1734-4f3b-808b-98c670b02154 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:55.534991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-a8e180f4-1734-4f3b-808b-98c670b02154 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:55.539835 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-84edda2a-58f2-4cf2-9cb7-4f97a3c8578b tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:55.541349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-84edda2a-58f2-4cf2-9cb7-4f97a3c8578b tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:55.541349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-84edda2a-58f2-4cf2-9cb7-4f97a3c8578b tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:55.541617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-84edda2a-58f2-4cf2-9cb7-4f97a3c8578b tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:55.541754 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a8e180f4-1734-4f3b-808b-98c670b02154 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:55.542174 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a8e180f4-1734-4f3b-808b-98c670b02154 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:55.542647 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a8e180f4-1734-4f3b-808b-98c670b02154 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:55.542793 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-84edda2a-58f2-4cf2-9cb7-4f97a3c8578b tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:55.543355 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-84edda2a-58f2-4cf2-9cb7-4f97a3c8578b tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:55.543481 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a8e180f4-1734-4f3b-808b-98c670b02154 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:55.543846 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a8e180f4-1734-4f3b-808b-98c670b02154 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:55.544312 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a8e180f4-1734-4f3b-808b-98c670b02154 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:55.766438 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-a8e180f4-1734-4f3b-808b-98c670b02154 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:55.779868 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-84edda2a-58f2-4cf2-9cb7-4f97a3c8578b tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:55.780123 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-a8e180f4-1734-4f3b-808b-98c670b02154 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1266 microversion: 2.1 time: 0.250462 Aug 07 22:43:55.780709 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 331/681] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:55 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:55.793293 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-84edda2a-58f2-4cf2-9cb7-4f97a3c8578b tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1570 microversion: 2.1 time: 0.265389 Aug 07 22:43:55.796972 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 351/682] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:55 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1570 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:56.201361 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-867d3ca6-6b62-4c83-a156-85fdf19b6a44 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:56.201972 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-867d3ca6-6b62-4c83-a156-85fdf19b6a44 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:56.208322 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-867d3ca6-6b62-4c83-a156-85fdf19b6a44 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:56.208811 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-867d3ca6-6b62-4c83-a156-85fdf19b6a44 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:56.209277 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-867d3ca6-6b62-4c83-a156-85fdf19b6a44 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:56.210193 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-867d3ca6-6b62-4c83-a156-85fdf19b6a44 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:56.210807 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-867d3ca6-6b62-4c83-a156-85fdf19b6a44 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:56.211268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-867d3ca6-6b62-4c83-a156-85fdf19b6a44 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:56.248078 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:56.349461 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=2 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:56.371778 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-867d3ca6-6b62-4c83-a156-85fdf19b6a44 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:56.383192 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-867d3ca6-6b62-4c83-a156-85fdf19b6a44 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:56.385633 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-867d3ca6-6b62-4c83-a156-85fdf19b6a44 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:56.387768 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-867d3ca6-6b62-4c83-a156-85fdf19b6a44 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1731 microversion: 2.20 time: 0.190806 Aug 07 22:43:56.405429 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 332/683] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:56 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1731 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:56.809618 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-9255cf7a-0688-40fe-8f70-833709fba888 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:56.810817 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-9255cf7a-0688-40fe-8f70-833709fba888 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:56.817538 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9255cf7a-0688-40fe-8f70-833709fba888 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:56.818308 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-b4a85b41-81f6-4e6a-8918-572d1110cb6d tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:56.818860 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9255cf7a-0688-40fe-8f70-833709fba888 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:56.818860 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9255cf7a-0688-40fe-8f70-833709fba888 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:56.819658 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-b4a85b41-81f6-4e6a-8918-572d1110cb6d tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:56.819923 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9255cf7a-0688-40fe-8f70-833709fba888 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:56.820746 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9255cf7a-0688-40fe-8f70-833709fba888 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:56.821064 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9255cf7a-0688-40fe-8f70-833709fba888 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:56.826998 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b4a85b41-81f6-4e6a-8918-572d1110cb6d tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:56.827494 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b4a85b41-81f6-4e6a-8918-572d1110cb6d tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:56.828134 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b4a85b41-81f6-4e6a-8918-572d1110cb6d tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:56.828805 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b4a85b41-81f6-4e6a-8918-572d1110cb6d tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:56.829269 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b4a85b41-81f6-4e6a-8918-572d1110cb6d tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:56.829708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b4a85b41-81f6-4e6a-8918-572d1110cb6d tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:56.882793 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=8 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:57.105808 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-b4a85b41-81f6-4e6a-8918-572d1110cb6d tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:57.121277 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-b4a85b41-81f6-4e6a-8918-572d1110cb6d tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1570 microversion: 2.1 time: 0.307545 Aug 07 22:43:57.122384 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-9255cf7a-0688-40fe-8f70-833709fba888 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:57.125298 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 333/684] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:56 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1570 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:43:57.139917 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-9255cf7a-0688-40fe-8f70-833709fba888 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1266 microversion: 2.1 time: 0.341779 Aug 07 22:43:57.142694 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 352/685] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:56 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1266 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:57.414742 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-f9af4e8f-9418-414d-b8a8-f0eb7df8b7ab tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:57.415383 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-f9af4e8f-9418-414d-b8a8-f0eb7df8b7ab tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:57.434291 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f9af4e8f-9418-414d-b8a8-f0eb7df8b7ab tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:57.435088 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f9af4e8f-9418-414d-b8a8-f0eb7df8b7ab tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:57.435585 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f9af4e8f-9418-414d-b8a8-f0eb7df8b7ab tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:57.436750 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f9af4e8f-9418-414d-b8a8-f0eb7df8b7ab tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:57.437206 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f9af4e8f-9418-414d-b8a8-f0eb7df8b7ab tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:57.437696 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f9af4e8f-9418-414d-b8a8-f0eb7df8b7ab tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:57.613340 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f9af4e8f-9418-414d-b8a8-f0eb7df8b7ab tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:57.627394 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f9af4e8f-9418-414d-b8a8-f0eb7df8b7ab tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:57.629302 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f9af4e8f-9418-414d-b8a8-f0eb7df8b7ab tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:57.630525 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-f9af4e8f-9418-414d-b8a8-f0eb7df8b7ab tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1731 microversion: 2.20 time: 0.221079 Aug 07 22:43:57.631699 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 334/686] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:57 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1731 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:58.145294 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-08fa9cfc-2d47-40f4-9f5f-edfc9e236a69 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:58.146085 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-08fa9cfc-2d47-40f4-9f5f-edfc9e236a69 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:58.148400 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=2 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:43:58.153314 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-08fa9cfc-2d47-40f4-9f5f-edfc9e236a69 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:58.153863 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-08fa9cfc-2d47-40f4-9f5f-edfc9e236a69 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:58.154297 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-08fa9cfc-2d47-40f4-9f5f-edfc9e236a69 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:58.155012 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-08fa9cfc-2d47-40f4-9f5f-edfc9e236a69 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:58.155458 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-08fa9cfc-2d47-40f4-9f5f-edfc9e236a69 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:58.155869 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-08fa9cfc-2d47-40f4-9f5f-edfc9e236a69 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:58.161521 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-455cadb9-688d-4a56-b2a8-76bfb09ea20d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:58.169975 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-455cadb9-688d-4a56-b2a8-76bfb09ea20d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:58.169975 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-455cadb9-688d-4a56-b2a8-76bfb09ea20d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:58.170326 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-455cadb9-688d-4a56-b2a8-76bfb09ea20d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:58.170769 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-455cadb9-688d-4a56-b2a8-76bfb09ea20d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:58.171497 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-455cadb9-688d-4a56-b2a8-76bfb09ea20d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:58.171990 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-455cadb9-688d-4a56-b2a8-76bfb09ea20d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:58.172408 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-455cadb9-688d-4a56-b2a8-76bfb09ea20d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:58.387575 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-08fa9cfc-2d47-40f4-9f5f-edfc9e236a69 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:58.399360 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-08fa9cfc-2d47-40f4-9f5f-edfc9e236a69 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1570 microversion: 2.1 time: 0.257854 Aug 07 22:43:58.401040 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 353/687] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:58 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1570 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:58.420617 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-455cadb9-688d-4a56-b2a8-76bfb09ea20d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:58.428457 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-455cadb9-688d-4a56-b2a8-76bfb09ea20d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1266 microversion: 2.1 time: 0.270900 Aug 07 22:43:58.441772 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 335/688] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:58 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:43:58.655855 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-4dddc90a-b14c-422d-97c4-f4dcfd325dab tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:58.656497 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-4dddc90a-b14c-422d-97c4-f4dcfd325dab tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:58.662418 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4dddc90a-b14c-422d-97c4-f4dcfd325dab tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:58.663504 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4dddc90a-b14c-422d-97c4-f4dcfd325dab tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:58.664143 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4dddc90a-b14c-422d-97c4-f4dcfd325dab tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:58.664829 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4dddc90a-b14c-422d-97c4-f4dcfd325dab tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:58.665282 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4dddc90a-b14c-422d-97c4-f4dcfd325dab tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:58.665703 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4dddc90a-b14c-422d-97c4-f4dcfd325dab tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:58.826495 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-4dddc90a-b14c-422d-97c4-f4dcfd325dab tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:58.837049 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-4dddc90a-b14c-422d-97c4-f4dcfd325dab tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:58.838595 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-4dddc90a-b14c-422d-97c4-f4dcfd325dab tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:58.839747 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-4dddc90a-b14c-422d-97c4-f4dcfd325dab tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1731 microversion: 2.20 time: 0.187755 Aug 07 22:43:58.840745 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 354/689] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:58 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:43:59.420988 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-8c3f20fe-32bb-41c2-a289-55ff220eeec8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:59.421611 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-8c3f20fe-32bb-41c2-a289-55ff220eeec8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:59.427793 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8c3f20fe-32bb-41c2-a289-55ff220eeec8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:59.431860 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8c3f20fe-32bb-41c2-a289-55ff220eeec8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:59.431860 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8c3f20fe-32bb-41c2-a289-55ff220eeec8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:59.431860 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8c3f20fe-32bb-41c2-a289-55ff220eeec8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:59.431860 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8c3f20fe-32bb-41c2-a289-55ff220eeec8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:59.432459 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8c3f20fe-32bb-41c2-a289-55ff220eeec8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:59.450733 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-8fb9a812-9eb3-438e-bfb5-fc2dfcbf174a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:59.452259 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-8fb9a812-9eb3-438e-bfb5-fc2dfcbf174a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:59.459217 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8fb9a812-9eb3-438e-bfb5-fc2dfcbf174a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:59.459730 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8fb9a812-9eb3-438e-bfb5-fc2dfcbf174a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:59.460587 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8fb9a812-9eb3-438e-bfb5-fc2dfcbf174a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:59.461355 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8fb9a812-9eb3-438e-bfb5-fc2dfcbf174a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:59.461830 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8fb9a812-9eb3-438e-bfb5-fc2dfcbf174a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:59.462254 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8fb9a812-9eb3-438e-bfb5-fc2dfcbf174a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:59.674475 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8c3f20fe-32bb-41c2-a289-55ff220eeec8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:59.682865 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-8c3f20fe-32bb-41c2-a289-55ff220eeec8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1570 microversion: 2.1 time: 0.265878 Aug 07 22:43:59.683436 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 336/690] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:59 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1570 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:59.697393 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-8fb9a812-9eb3-438e-bfb5-fc2dfcbf174a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:43:59.704813 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-8fb9a812-9eb3-438e-bfb5-fc2dfcbf174a tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1266 microversion: 2.1 time: 0.259071 Aug 07 22:43:59.705421 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 355/691] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:43:59 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:43:59.862698 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-3e072a01-71ee-4ef5-981d-61d4f0cc8a8b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:43:59.863308 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-3e072a01-71ee-4ef5-981d-61d4f0cc8a8b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:43:59.869531 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3e072a01-71ee-4ef5-981d-61d4f0cc8a8b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:59.870034 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3e072a01-71ee-4ef5-981d-61d4f0cc8a8b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:59.870468 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3e072a01-71ee-4ef5-981d-61d4f0cc8a8b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:43:59.871150 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3e072a01-71ee-4ef5-981d-61d4f0cc8a8b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:43:59.871597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3e072a01-71ee-4ef5-981d-61d4f0cc8a8b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:43:59.872104 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3e072a01-71ee-4ef5-981d-61d4f0cc8a8b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:00.047538 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-3e072a01-71ee-4ef5-981d-61d4f0cc8a8b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:00.058463 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-3e072a01-71ee-4ef5-981d-61d4f0cc8a8b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:00.058463 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-3e072a01-71ee-4ef5-981d-61d4f0cc8a8b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:00.059002 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-3e072a01-71ee-4ef5-981d-61d4f0cc8a8b tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1731 microversion: 2.20 time: 0.200199 Aug 07 22:44:00.059911 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 337/692] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:43:59 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:44:00.704618 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-2976ee7d-7b15-470d-b00a-26799af3cf69 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:00.705243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-2976ee7d-7b15-470d-b00a-26799af3cf69 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:00.715197 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2976ee7d-7b15-470d-b00a-26799af3cf69 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:00.715688 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2976ee7d-7b15-470d-b00a-26799af3cf69 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:00.716154 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2976ee7d-7b15-470d-b00a-26799af3cf69 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:00.717013 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2976ee7d-7b15-470d-b00a-26799af3cf69 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:00.717516 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2976ee7d-7b15-470d-b00a-26799af3cf69 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:00.717937 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2976ee7d-7b15-470d-b00a-26799af3cf69 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:00.739857 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7b515b80-3301-4a49-ae08-33c433b72fdd tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:00.740532 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-7b515b80-3301-4a49-ae08-33c433b72fdd tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:00.747875 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7b515b80-3301-4a49-ae08-33c433b72fdd tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:00.748402 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7b515b80-3301-4a49-ae08-33c433b72fdd tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:00.749048 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7b515b80-3301-4a49-ae08-33c433b72fdd tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:00.749755 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7b515b80-3301-4a49-ae08-33c433b72fdd tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:00.750212 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7b515b80-3301-4a49-ae08-33c433b72fdd tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:00.750825 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7b515b80-3301-4a49-ae08-33c433b72fdd tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:00.943354 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-2976ee7d-7b15-470d-b00a-26799af3cf69 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:00.951237 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-2976ee7d-7b15-470d-b00a-26799af3cf69 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1570 microversion: 2.1 time: 0.250564 Aug 07 22:44:00.952918 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 356/693] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:00 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1570 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:00.972160 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7b515b80-3301-4a49-ae08-33c433b72fdd tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:00.986675 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-7b515b80-3301-4a49-ae08-33c433b72fdd tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1266 microversion: 2.1 time: 0.250019 Aug 07 22:44:00.987790 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 338/694] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:00 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:01.082485 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-649422e0-d821-4363-aff1-d9ca56c115dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:01.083374 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-649422e0-d821-4363-aff1-d9ca56c115dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:01.090100 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-649422e0-d821-4363-aff1-d9ca56c115dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:01.090589 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-649422e0-d821-4363-aff1-d9ca56c115dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:01.091155 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-649422e0-d821-4363-aff1-d9ca56c115dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:01.091848 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-649422e0-d821-4363-aff1-d9ca56c115dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:01.092318 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-649422e0-d821-4363-aff1-d9ca56c115dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:01.092739 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-649422e0-d821-4363-aff1-d9ca56c115dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:01.530103 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-649422e0-d821-4363-aff1-d9ca56c115dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:01.538034 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-649422e0-d821-4363-aff1-d9ca56c115dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:01.539642 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-649422e0-d821-4363-aff1-d9ca56c115dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:01.540823 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-649422e0-d821-4363-aff1-d9ca56c115dc tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1731 microversion: 2.20 time: 0.462509 Aug 07 22:44:01.544727 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 357/695] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:44:01 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1731 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:44:01.973424 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-756a743d-0ffc-4154-ae8c-59f6fba5f32e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:01.973936 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-756a743d-0ffc-4154-ae8c-59f6fba5f32e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:01.981392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-756a743d-0ffc-4154-ae8c-59f6fba5f32e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:01.981879 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-756a743d-0ffc-4154-ae8c-59f6fba5f32e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:01.982334 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-756a743d-0ffc-4154-ae8c-59f6fba5f32e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:01.983059 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-756a743d-0ffc-4154-ae8c-59f6fba5f32e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:01.983510 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-756a743d-0ffc-4154-ae8c-59f6fba5f32e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:01.983929 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-756a743d-0ffc-4154-ae8c-59f6fba5f32e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:02.008656 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-bfdf9662-e657-4145-af12-02a46008a39c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:02.009398 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-bfdf9662-e657-4145-af12-02a46008a39c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:02.016506 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bfdf9662-e657-4145-af12-02a46008a39c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:02.016995 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bfdf9662-e657-4145-af12-02a46008a39c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:02.017431 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bfdf9662-e657-4145-af12-02a46008a39c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:02.018123 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bfdf9662-e657-4145-af12-02a46008a39c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:02.018602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bfdf9662-e657-4145-af12-02a46008a39c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:02.019033 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bfdf9662-e657-4145-af12-02a46008a39c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:02.168739 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-756a743d-0ffc-4154-ae8c-59f6fba5f32e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:02.176571 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-756a743d-0ffc-4154-ae8c-59f6fba5f32e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1570 microversion: 2.1 time: 0.207095 Aug 07 22:44:02.177149 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 339/696] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:01 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1570 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:02.204522 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-bfdf9662-e657-4145-af12-02a46008a39c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:02.215281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-bfdf9662-e657-4145-af12-02a46008a39c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1266 microversion: 2.1 time: 0.209997 Aug 07 22:44:02.216204 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 358/697] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:02 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:44:02.569772 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-5cf2e764-c38b-4d93-bc84-09b62343da18 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:02.570696 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-5cf2e764-c38b-4d93-bc84-09b62343da18 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:02.577192 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5cf2e764-c38b-4d93-bc84-09b62343da18 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:02.577685 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5cf2e764-c38b-4d93-bc84-09b62343da18 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:02.578118 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5cf2e764-c38b-4d93-bc84-09b62343da18 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:02.579197 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5cf2e764-c38b-4d93-bc84-09b62343da18 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:02.579823 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5cf2e764-c38b-4d93-bc84-09b62343da18 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:02.580443 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5cf2e764-c38b-4d93-bc84-09b62343da18 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:02.721037 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-5cf2e764-c38b-4d93-bc84-09b62343da18 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:02.729562 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-5cf2e764-c38b-4d93-bc84-09b62343da18 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:02.731070 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-5cf2e764-c38b-4d93-bc84-09b62343da18 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:02.732279 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-5cf2e764-c38b-4d93-bc84-09b62343da18 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1731 microversion: 2.20 time: 0.166953 Aug 07 22:44:02.732854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 340/698] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:44:02 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 22:44:03.204770 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-930ef520-d064-47b6-9980-670ceee13f6e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:03.204770 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-930ef520-d064-47b6-9980-670ceee13f6e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:03.206232 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-930ef520-d064-47b6-9980-670ceee13f6e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:03.206696 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-930ef520-d064-47b6-9980-670ceee13f6e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:03.207131 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-930ef520-d064-47b6-9980-670ceee13f6e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:03.207825 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-930ef520-d064-47b6-9980-670ceee13f6e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:03.208329 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-930ef520-d064-47b6-9980-670ceee13f6e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:03.208917 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-930ef520-d064-47b6-9980-670ceee13f6e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:03.239595 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-41f6468a-6665-4bda-8efa-9ea2398735d8 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:03.243225 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-41f6468a-6665-4bda-8efa-9ea2398735d8 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:03.248951 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-41f6468a-6665-4bda-8efa-9ea2398735d8 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:03.249725 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-41f6468a-6665-4bda-8efa-9ea2398735d8 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:03.250270 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-41f6468a-6665-4bda-8efa-9ea2398735d8 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:03.251072 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-41f6468a-6665-4bda-8efa-9ea2398735d8 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:03.251777 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-41f6468a-6665-4bda-8efa-9ea2398735d8 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:03.252583 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-41f6468a-6665-4bda-8efa-9ea2398735d8 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:03.414080 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-930ef520-d064-47b6-9980-670ceee13f6e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:03.421625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-930ef520-d064-47b6-9980-670ceee13f6e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1570 microversion: 2.1 time: 0.226743 Aug 07 22:44:03.422191 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 359/699] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:03 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1570 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:03.440487 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-41f6468a-6665-4bda-8efa-9ea2398735d8 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:03.448312 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-41f6468a-6665-4bda-8efa-9ea2398735d8 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1266 microversion: 2.1 time: 0.212860 Aug 07 22:44:03.448889 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 341/700] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:03 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:44:03.755417 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-558174cb-c685-49c7-94b4-ad8507a6d41d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:03.756043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-558174cb-c685-49c7-94b4-ad8507a6d41d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:03.762330 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-558174cb-c685-49c7-94b4-ad8507a6d41d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:03.762812 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-558174cb-c685-49c7-94b4-ad8507a6d41d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:03.763296 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-558174cb-c685-49c7-94b4-ad8507a6d41d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:03.763975 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-558174cb-c685-49c7-94b4-ad8507a6d41d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:03.764453 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-558174cb-c685-49c7-94b4-ad8507a6d41d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:03.764875 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-558174cb-c685-49c7-94b4-ad8507a6d41d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:03.898442 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-558174cb-c685-49c7-94b4-ad8507a6d41d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:03.906486 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-558174cb-c685-49c7-94b4-ad8507a6d41d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:03.908092 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-558174cb-c685-49c7-94b4-ad8507a6d41d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:03.909294 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-558174cb-c685-49c7-94b4-ad8507a6d41d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1731 microversion: 2.20 time: 0.157797 Aug 07 22:44:03.909846 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 360/701] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:44:03 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:44:04.296174 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-1a5b44ae-c43a-4246-8d90-003adaec173e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-355716111", "imageRef": "91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8", "flavorRef": "452", "networks": [{"uuid": "68262f02-e373-4d41-8919-e2f8b833fcb3"}]}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:44:04.351138 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-886c8381-2f40-4639-b357-cca46b118cbb req-2e26e270-9484-4238-a359-e8416eda6414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cef2464-0337-4fbd-a727-a24160f14f99", "name": "network-vif-plugged", "status": "completed", "tag": "28f8e101-7a4a-4833-b344-83657618e970"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:44:04.353391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.network.neutron [None req-1a5b44ae-c43a-4246-8d90-003adaec173e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] validate_networks() for [('68262f02-e373-4d41-8919-e2f8b833fcb3', None, None, None, None, None)] {{(pid=129965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 22:44:04.363474 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-886c8381-2f40-4639-b357-cca46b118cbb req-2e26e270-9484-4238-a359-e8416eda6414 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:04.364448 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-886c8381-2f40-4639-b357-cca46b118cbb req-2e26e270-9484-4238-a359-e8416eda6414 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:04.365068 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-886c8381-2f40-4639-b357-cca46b118cbb req-2e26e270-9484-4238-a359-e8416eda6414 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:04.378475 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-886c8381-2f40-4639-b357-cca46b118cbb req-2e26e270-9484-4238-a359-e8416eda6414 service nova] Creating event network-vif-plugged:28f8e101-7a4a-4833-b344-83657618e970 for instance 9cef2464-0337-4fbd-a727-a24160f14f99 on hv-cinder-85032 Aug 07 22:44:04.384876 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-886c8381-2f40-4639-b357-cca46b118cbb req-2e26e270-9484-4238-a359-e8416eda6414 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038957 Aug 07 22:44:04.386870 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 361/702] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:44:04.445253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-6cc74f36-9e4f-46f1-81e3-1b3f9e8a1c51 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:04.447208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-6cc74f36-9e4f-46f1-81e3-1b3f9e8a1c51 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:04.452686 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6cc74f36-9e4f-46f1-81e3-1b3f9e8a1c51 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:04.453360 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6cc74f36-9e4f-46f1-81e3-1b3f9e8a1c51 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:04.453872 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6cc74f36-9e4f-46f1-81e3-1b3f9e8a1c51 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:04.454652 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6cc74f36-9e4f-46f1-81e3-1b3f9e8a1c51 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:04.455112 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6cc74f36-9e4f-46f1-81e3-1b3f9e8a1c51 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:04.455542 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6cc74f36-9e4f-46f1-81e3-1b3f9e8a1c51 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:04.684720 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-6cc74f36-9e4f-46f1-81e3-1b3f9e8a1c51 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:04.693238 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-6cc74f36-9e4f-46f1-81e3-1b3f9e8a1c51 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1571 microversion: 2.1 time: 0.253090 Aug 07 22:44:04.693885 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 362/703] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:04 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1571 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:44:04.698881 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-354445ec-1ac9-4743-b9e4-f693bbf09493 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:04.699648 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-354445ec-1ac9-4743-b9e4-f693bbf09493 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:04.705547 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-354445ec-1ac9-4743-b9e4-f693bbf09493 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:04.706280 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-354445ec-1ac9-4743-b9e4-f693bbf09493 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:04.706895 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-354445ec-1ac9-4743-b9e4-f693bbf09493 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:04.707759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-354445ec-1ac9-4743-b9e4-f693bbf09493 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:04.708454 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-354445ec-1ac9-4743-b9e4-f693bbf09493 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:04.709025 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-354445ec-1ac9-4743-b9e4-f693bbf09493 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:04.889367 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-1a5b44ae-c43a-4246-8d90-003adaec173e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Flavor limits 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 22:44:04.889801 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-1a5b44ae-c43a-4246-8d90-003adaec173e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Image limits 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 22:44:04.890281 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-1a5b44ae-c43a-4246-8d90-003adaec173e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Flavor pref 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 22:44:04.890691 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-1a5b44ae-c43a-4246-8d90-003adaec173e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Image pref 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 22:44:04.891106 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-1a5b44ae-c43a-4246-8d90-003adaec173e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 22:44:04.900490 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1a5b44ae-c43a-4246-8d90-003adaec173e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:04.901170 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1a5b44ae-c43a-4246-8d90-003adaec173e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:04.901702 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1a5b44ae-c43a-4246-8d90-003adaec173e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:04.902658 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1a5b44ae-c43a-4246-8d90-003adaec173e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:04.903254 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1a5b44ae-c43a-4246-8d90-003adaec173e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:04.903975 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1a5b44ae-c43a-4246-8d90-003adaec173e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:04.923973 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-1a5b44ae-c43a-4246-8d90-003adaec173e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Getting quotas for project 2648957a96504832a5693026f9d99c58. Resources: {'cores', 'instances', 'ram'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:44:04.925978 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:44:04.930281 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-1a5b44ae-c43a-4246-8d90-003adaec173e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Getting quotas for user 269193a67b504842b3858022b378ae2a and project 2648957a96504832a5693026f9d99c58. Resources: {'cores', 'instances', 'ram'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:44:04.941734 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-1a5b44ae-c43a-4246-8d90-003adaec173e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Going to run 1 instances... {{(pid=129965) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 22:44:04.944046 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-1a5b44ae-c43a-4246-8d90-003adaec173e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: b0dce4a6-327d-4d94-b3ea-a329edef8130] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 22:44:04.944952 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-354445ec-1ac9-4743-b9e4-f693bbf09493 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:04.952665 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-354445ec-1ac9-4743-b9e4-f693bbf09493 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1266 microversion: 2.1 time: 0.257596 Aug 07 22:44:04.953230 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 363/704] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:04 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:04.960937 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-6f429094-a99e-4321-96bb-66df7f6e1e68 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:44:04.961531 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-6f429094-a99e-4321-96bb-66df7f6e1e68 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:04.969953 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6f429094-a99e-4321-96bb-66df7f6e1e68 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:04.970440 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6f429094-a99e-4321-96bb-66df7f6e1e68 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:04.970874 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6f429094-a99e-4321-96bb-66df7f6e1e68 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:04.971567 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6f429094-a99e-4321-96bb-66df7f6e1e68 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:04.972046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6f429094-a99e-4321-96bb-66df7f6e1e68 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:04.972498 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6f429094-a99e-4321-96bb-66df7f6e1e68 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:05.005331 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-6f429094-a99e-4321-96bb-66df7f6e1e68 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129964) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 07 22:44:05.085964 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-1a5b44ae-c43a-4246-8d90-003adaec173e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.793798 Aug 07 22:44:05.086638 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 342/705] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 22:44:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 22:44:05.092326 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-93cc348f-e431-4209-a6fa-4b22d7dbc3b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:05.092326 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-93cc348f-e431-4209-a6fa-4b22d7dbc3b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:05.097992 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-93cc348f-e431-4209-a6fa-4b22d7dbc3b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:05.098471 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-93cc348f-e431-4209-a6fa-4b22d7dbc3b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:05.098900 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-93cc348f-e431-4209-a6fa-4b22d7dbc3b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:05.099585 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-93cc348f-e431-4209-a6fa-4b22d7dbc3b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:05.100716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-93cc348f-e431-4209-a6fa-4b22d7dbc3b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:05.101013 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-93cc348f-e431-4209-a6fa-4b22d7dbc3b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:05.251278 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-93cc348f-e431-4209-a6fa-4b22d7dbc3b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:05.259655 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-93cc348f-e431-4209-a6fa-4b22d7dbc3b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:05.264834 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-93cc348f-e431-4209-a6fa-4b22d7dbc3b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:05.264834 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-93cc348f-e431-4209-a6fa-4b22d7dbc3b5 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1731 microversion: 2.20 time: 0.175018 Aug 07 22:44:05.264834 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 343/706] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:44:05 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:44:05.267480 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7ffb3621-0fd7-4b55-b4da-7a68e1ef441b tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:05.268117 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-7ffb3621-0fd7-4b55-b4da-7a68e1ef441b tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: b0dce4a6-327d-4d94-b3ea-a329edef8130] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:05.321996 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7ffb3621-0fd7-4b55-b4da-7a68e1ef441b tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:05.328811 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-7ffb3621-0fd7-4b55-b4da-7a68e1ef441b tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130" status: 200 len: 1213 microversion: 2.1 time: 0.064765 Aug 07 22:44:05.329380 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 344/707] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:05 2022] GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130 => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:05.373639 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-6f429094-a99e-4321-96bb-66df7f6e1e68 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "POST /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994/action" status: 202 len: 0 microversion: 2.1 time: 0.418999 Aug 07 22:44:05.376063 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 364/708] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 22:44:04 2022] POST /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:44:05.382884 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-a70123b3-b764-44ff-ab03-cb134c84b8d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:05.383498 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-a70123b3-b764-44ff-ab03-cb134c84b8d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:05.390843 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a70123b3-b764-44ff-ab03-cb134c84b8d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:05.393064 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a70123b3-b764-44ff-ab03-cb134c84b8d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:05.393064 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a70123b3-b764-44ff-ab03-cb134c84b8d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:05.393064 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a70123b3-b764-44ff-ab03-cb134c84b8d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:05.393064 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a70123b3-b764-44ff-ab03-cb134c84b8d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:05.393428 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a70123b3-b764-44ff-ab03-cb134c84b8d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:05.539267 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-a70123b3-b764-44ff-ab03-cb134c84b8d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:05.545257 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-a70123b3-b764-44ff-ab03-cb134c84b8d1 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1519 microversion: 2.1 time: 0.166653 Aug 07 22:44:05.545972 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 345/709] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:05 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:44:05.973993 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-898b8109-27c1-4037-b264-3a4ab455e4c9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:05.974607 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-898b8109-27c1-4037-b264-3a4ab455e4c9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:05.981336 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-898b8109-27c1-4037-b264-3a4ab455e4c9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:05.981816 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-898b8109-27c1-4037-b264-3a4ab455e4c9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:05.982254 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-898b8109-27c1-4037-b264-3a4ab455e4c9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:05.982946 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-898b8109-27c1-4037-b264-3a4ab455e4c9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:05.983397 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-898b8109-27c1-4037-b264-3a4ab455e4c9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:05.983818 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-898b8109-27c1-4037-b264-3a4ab455e4c9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:06.115515 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-898b8109-27c1-4037-b264-3a4ab455e4c9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:06.119256 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:44:06.124077 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-898b8109-27c1-4037-b264-3a4ab455e4c9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1266 microversion: 2.1 time: 0.154087 Aug 07 22:44:06.124646 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 365/710] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:05 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:06.286601 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7ebc9458-2cdb-4586-a8f6-52e39f2b2319 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:06.287196 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-7ebc9458-2cdb-4586-a8f6-52e39f2b2319 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:06.293724 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7ebc9458-2cdb-4586-a8f6-52e39f2b2319 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:06.297925 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7ebc9458-2cdb-4586-a8f6-52e39f2b2319 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:06.297925 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7ebc9458-2cdb-4586-a8f6-52e39f2b2319 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:06.297925 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7ebc9458-2cdb-4586-a8f6-52e39f2b2319 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:06.297925 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7ebc9458-2cdb-4586-a8f6-52e39f2b2319 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:06.298408 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7ebc9458-2cdb-4586-a8f6-52e39f2b2319 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:06.349466 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a546c283-3df1-45e5-9cbc-02c299a436c3 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:06.350083 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a546c283-3df1-45e5-9cbc-02c299a436c3 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: b0dce4a6-327d-4d94-b3ea-a329edef8130] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:06.356725 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a546c283-3df1-45e5-9cbc-02c299a436c3 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:06.357206 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a546c283-3df1-45e5-9cbc-02c299a436c3 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:06.361013 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a546c283-3df1-45e5-9cbc-02c299a436c3 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:06.361013 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a546c283-3df1-45e5-9cbc-02c299a436c3 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:06.361013 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a546c283-3df1-45e5-9cbc-02c299a436c3 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:06.361013 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a546c283-3df1-45e5-9cbc-02c299a436c3 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:06.481144 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7ebc9458-2cdb-4586-a8f6-52e39f2b2319 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:06.495336 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7ebc9458-2cdb-4586-a8f6-52e39f2b2319 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:06.497177 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7ebc9458-2cdb-4586-a8f6-52e39f2b2319 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:06.498011 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-a546c283-3df1-45e5-9cbc-02c299a436c3 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:06.498670 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-7ebc9458-2cdb-4586-a8f6-52e39f2b2319 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1731 microversion: 2.20 time: 0.216024 Aug 07 22:44:06.499790 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 346/711] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:44:06 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1731 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:44:06.509234 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a546c283-3df1-45e5-9cbc-02c299a436c3 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130" status: 200 len: 1217 microversion: 2.1 time: 0.160875 Aug 07 22:44:06.510018 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 366/712] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:06 2022] GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130 => generated 1217 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:44:06.562581 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-4cf7bb48-540e-4a93-bd6e-7a8868f269bf req-f84b0a37-7bea-45cf-aec5-1c0f8641e6ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93991d13-4c43-4e03-9031-2d5032989994", "name": "network-vif-unplugged", "status": "completed", "tag": "2b5b8b0f-84c3-482a-be06-dd81e2a229e1"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:44:06.569450 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-1f8ccce4-0def-41ee-8687-817386187add tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:06.570069 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-1f8ccce4-0def-41ee-8687-817386187add tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:06.573527 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-4cf7bb48-540e-4a93-bd6e-7a8868f269bf req-f84b0a37-7bea-45cf-aec5-1c0f8641e6ae service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:06.574014 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-4cf7bb48-540e-4a93-bd6e-7a8868f269bf req-f84b0a37-7bea-45cf-aec5-1c0f8641e6ae service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:06.574536 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-4cf7bb48-540e-4a93-bd6e-7a8868f269bf req-f84b0a37-7bea-45cf-aec5-1c0f8641e6ae service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:06.576761 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1f8ccce4-0def-41ee-8687-817386187add tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:06.577235 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1f8ccce4-0def-41ee-8687-817386187add tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:06.577671 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1f8ccce4-0def-41ee-8687-817386187add tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:06.578502 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1f8ccce4-0def-41ee-8687-817386187add tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:06.578951 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1f8ccce4-0def-41ee-8687-817386187add tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:06.579519 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1f8ccce4-0def-41ee-8687-817386187add tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:06.588159 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.compute.server_external_events [req-4cf7bb48-540e-4a93-bd6e-7a8868f269bf req-f84b0a37-7bea-45cf-aec5-1c0f8641e6ae service nova] Unable to find a host for instance 93991d13-4c43-4e03-9031-2d5032989994. Dropping event network-vif-unplugged {{(pid=129965) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 07 22:44:06.589050 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-4cf7bb48-540e-4a93-bd6e-7a8868f269bf req-f84b0a37-7bea-45cf-aec5-1c0f8641e6ae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030963 Aug 07 22:44:06.589656 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 347/713] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 07 22:44:06.725967 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-1f8ccce4-0def-41ee-8687-817386187add tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:06.733821 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-1f8ccce4-0def-41ee-8687-817386187add tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1519 microversion: 2.1 time: 0.169210 Aug 07 22:44:06.734388 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 367/714] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:06 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:07.145321 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-68f851f6-6c8c-4ac1-baaf-90ea9a583d6d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:07.145978 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-68f851f6-6c8c-4ac1-baaf-90ea9a583d6d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:07.152669 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-68f851f6-6c8c-4ac1-baaf-90ea9a583d6d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:07.153147 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-68f851f6-6c8c-4ac1-baaf-90ea9a583d6d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:07.153578 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-68f851f6-6c8c-4ac1-baaf-90ea9a583d6d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:07.154261 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-68f851f6-6c8c-4ac1-baaf-90ea9a583d6d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:07.154709 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-68f851f6-6c8c-4ac1-baaf-90ea9a583d6d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:07.155132 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-68f851f6-6c8c-4ac1-baaf-90ea9a583d6d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:07.293367 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-68f851f6-6c8c-4ac1-baaf-90ea9a583d6d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:07.301868 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-68f851f6-6c8c-4ac1-baaf-90ea9a583d6d tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1266 microversion: 2.1 time: 0.160333 Aug 07 22:44:07.302504 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 348/715] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:07 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:07.524800 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-5620403b-fa8a-4fa2-bf2d-999b694a1831 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:07.526182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-5620403b-fa8a-4fa2-bf2d-999b694a1831 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:07.529881 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ec1d0bc1-9301-40b9-9baa-e139b6c7810b tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:07.530512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-ec1d0bc1-9301-40b9-9baa-e139b6c7810b tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: b0dce4a6-327d-4d94-b3ea-a329edef8130] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:07.533407 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5620403b-fa8a-4fa2-bf2d-999b694a1831 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:07.533900 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5620403b-fa8a-4fa2-bf2d-999b694a1831 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:07.534635 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5620403b-fa8a-4fa2-bf2d-999b694a1831 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:07.535515 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5620403b-fa8a-4fa2-bf2d-999b694a1831 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:07.536154 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5620403b-fa8a-4fa2-bf2d-999b694a1831 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:07.536586 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5620403b-fa8a-4fa2-bf2d-999b694a1831 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:07.539309 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ec1d0bc1-9301-40b9-9baa-e139b6c7810b tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:07.539796 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ec1d0bc1-9301-40b9-9baa-e139b6c7810b tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:07.540412 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ec1d0bc1-9301-40b9-9baa-e139b6c7810b tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:07.542717 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ec1d0bc1-9301-40b9-9baa-e139b6c7810b tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:07.542717 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ec1d0bc1-9301-40b9-9baa-e139b6c7810b tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:07.542717 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ec1d0bc1-9301-40b9-9baa-e139b6c7810b tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:07.630325 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-ec1d0bc1-9301-40b9-9baa-e139b6c7810b tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:07.638385 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-ec1d0bc1-9301-40b9-9baa-e139b6c7810b tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130" status: 200 len: 1209 microversion: 2.1 time: 0.112641 Aug 07 22:44:07.638955 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 349/716] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:07 2022] GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130 => generated 1209 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:44:07.713800 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-5620403b-fa8a-4fa2-bf2d-999b694a1831 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:07.721682 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-5620403b-fa8a-4fa2-bf2d-999b694a1831 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:07.723362 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-5620403b-fa8a-4fa2-bf2d-999b694a1831 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:07.724535 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-5620403b-fa8a-4fa2-bf2d-999b694a1831 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1731 microversion: 2.20 time: 0.204773 Aug 07 22:44:07.725712 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 368/717] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:44:07 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1731 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:44:07.754863 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-f37ab6c7-07c7-4e64-83ef-3bb75eae1b65 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:07.755498 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-f37ab6c7-07c7-4e64-83ef-3bb75eae1b65 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:07.762661 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f37ab6c7-07c7-4e64-83ef-3bb75eae1b65 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:07.763136 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f37ab6c7-07c7-4e64-83ef-3bb75eae1b65 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:07.763565 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f37ab6c7-07c7-4e64-83ef-3bb75eae1b65 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:07.765296 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f37ab6c7-07c7-4e64-83ef-3bb75eae1b65 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:07.765879 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f37ab6c7-07c7-4e64-83ef-3bb75eae1b65 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:07.766983 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f37ab6c7-07c7-4e64-83ef-3bb75eae1b65 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:07.909872 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f37ab6c7-07c7-4e64-83ef-3bb75eae1b65 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:07.921931 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-f37ab6c7-07c7-4e64-83ef-3bb75eae1b65 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1521 microversion: 2.1 time: 0.170983 Aug 07 22:44:07.922618 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 350/718] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:07 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:08.322452 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f517f833-1d77-49d0-989b-1b3e2035ca0c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:08.323067 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f517f833-1d77-49d0-989b-1b3e2035ca0c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:08.329476 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f517f833-1d77-49d0-989b-1b3e2035ca0c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:08.329961 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f517f833-1d77-49d0-989b-1b3e2035ca0c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:08.330741 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f517f833-1d77-49d0-989b-1b3e2035ca0c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:08.331334 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f517f833-1d77-49d0-989b-1b3e2035ca0c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:08.331790 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f517f833-1d77-49d0-989b-1b3e2035ca0c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:08.332251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f517f833-1d77-49d0-989b-1b3e2035ca0c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:08.490554 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f517f833-1d77-49d0-989b-1b3e2035ca0c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:08.499108 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f517f833-1d77-49d0-989b-1b3e2035ca0c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1266 microversion: 2.1 time: 0.180656 Aug 07 22:44:08.499684 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 369/719] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:08 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:08.666671 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-e85f1c78-3175-4e4e-afa2-94fb67f382b8 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:08.667292 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-e85f1c78-3175-4e4e-afa2-94fb67f382b8 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: b0dce4a6-327d-4d94-b3ea-a329edef8130] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:08.680422 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e85f1c78-3175-4e4e-afa2-94fb67f382b8 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:08.680951 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e85f1c78-3175-4e4e-afa2-94fb67f382b8 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:08.681402 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e85f1c78-3175-4e4e-afa2-94fb67f382b8 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:08.682149 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e85f1c78-3175-4e4e-afa2-94fb67f382b8 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:08.682777 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e85f1c78-3175-4e4e-afa2-94fb67f382b8 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:08.683289 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e85f1c78-3175-4e4e-afa2-94fb67f382b8 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:08.704000 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=100 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:44:08.757888 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-6870dcf9-096f-4055-aa39-169294eba3db tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:08.758516 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-6870dcf9-096f-4055-aa39-169294eba3db tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:08.765712 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6870dcf9-096f-4055-aa39-169294eba3db tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:08.766271 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6870dcf9-096f-4055-aa39-169294eba3db tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:08.766904 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6870dcf9-096f-4055-aa39-169294eba3db tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:08.767905 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6870dcf9-096f-4055-aa39-169294eba3db tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:08.768455 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6870dcf9-096f-4055-aa39-169294eba3db tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:08.769241 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6870dcf9-096f-4055-aa39-169294eba3db tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:08.809241 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-e85f1c78-3175-4e4e-afa2-94fb67f382b8 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:08.846158 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-e85f1c78-3175-4e4e-afa2-94fb67f382b8 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130" status: 200 len: 1273 microversion: 2.1 time: 0.179371 Aug 07 22:44:08.847252 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 351/720] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:08 2022] GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130 => generated 1273 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:08.852237 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-cfb97222-6bf2-427c-ae42-219cd6e22386 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:08.852919 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-cfb97222-6bf2-427c-ae42-219cd6e22386 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:08.861399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cfb97222-6bf2-427c-ae42-219cd6e22386 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:08.861899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cfb97222-6bf2-427c-ae42-219cd6e22386 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:08.862324 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cfb97222-6bf2-427c-ae42-219cd6e22386 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:08.863020 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cfb97222-6bf2-427c-ae42-219cd6e22386 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:08.863472 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cfb97222-6bf2-427c-ae42-219cd6e22386 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:08.863891 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cfb97222-6bf2-427c-ae42-219cd6e22386 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:09.079046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-6870dcf9-096f-4055-aa39-169294eba3db tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:09.086477 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-cfb97222-6bf2-427c-ae42-219cd6e22386 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:09.087819 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-6870dcf9-096f-4055-aa39-169294eba3db tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:09.090303 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-6870dcf9-096f-4055-aa39-169294eba3db tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:09.101078 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-6870dcf9-096f-4055-aa39-169294eba3db tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1718 microversion: 2.20 time: 0.338019 Aug 07 22:44:09.101078 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 370/721] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:44:08 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1718 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:44:09.101078 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-c492627d-f562-4c10-ad55-9d210287f667 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:09.101078 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-c492627d-f562-4c10-ad55-9d210287f667 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:09.105247 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-cfb97222-6bf2-427c-ae42-219cd6e22386 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1594 microversion: 2.1 time: 0.256791 Aug 07 22:44:09.106444 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 352/722] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:08 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1594 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:09.117992 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c492627d-f562-4c10-ad55-9d210287f667 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:09.117992 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c492627d-f562-4c10-ad55-9d210287f667 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:09.117992 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c492627d-f562-4c10-ad55-9d210287f667 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:09.117992 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c492627d-f562-4c10-ad55-9d210287f667 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:09.118995 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c492627d-f562-4c10-ad55-9d210287f667 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:09.118995 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c492627d-f562-4c10-ad55-9d210287f667 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:09.317222 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-c492627d-f562-4c10-ad55-9d210287f667 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:09.325894 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-c492627d-f562-4c10-ad55-9d210287f667 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1521 microversion: 2.1 time: 0.233204 Aug 07 22:44:09.326478 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 371/723] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:09 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:09.520886 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-89d11644-13ef-473b-96fd-19352dee8c43 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:09.521502 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-89d11644-13ef-473b-96fd-19352dee8c43 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:09.528504 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-89d11644-13ef-473b-96fd-19352dee8c43 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:09.528996 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-89d11644-13ef-473b-96fd-19352dee8c43 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:09.529439 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-89d11644-13ef-473b-96fd-19352dee8c43 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:09.530212 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-89d11644-13ef-473b-96fd-19352dee8c43 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:09.530648 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-89d11644-13ef-473b-96fd-19352dee8c43 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:09.531069 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-89d11644-13ef-473b-96fd-19352dee8c43 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:09.772559 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-89d11644-13ef-473b-96fd-19352dee8c43 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:09.778840 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-89d11644-13ef-473b-96fd-19352dee8c43 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1266 microversion: 2.1 time: 0.261847 Aug 07 22:44:09.779420 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 353/724] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:09 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:09.867780 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-e55d4a4f-3794-4537-84f2-0af7bf5180ae tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:09.868513 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-e55d4a4f-3794-4537-84f2-0af7bf5180ae tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: b0dce4a6-327d-4d94-b3ea-a329edef8130] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:09.870906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:44:09.875546 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e55d4a4f-3794-4537-84f2-0af7bf5180ae tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:09.876206 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e55d4a4f-3794-4537-84f2-0af7bf5180ae tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:09.876715 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e55d4a4f-3794-4537-84f2-0af7bf5180ae tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:09.877494 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e55d4a4f-3794-4537-84f2-0af7bf5180ae tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:09.878032 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e55d4a4f-3794-4537-84f2-0af7bf5180ae tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:09.878527 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e55d4a4f-3794-4537-84f2-0af7bf5180ae tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:10.014617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-e55d4a4f-3794-4537-84f2-0af7bf5180ae tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:10.023490 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-e55d4a4f-3794-4537-84f2-0af7bf5180ae tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130" status: 200 len: 1313 microversion: 2.1 time: 0.159773 Aug 07 22:44:10.024069 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 372/725] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:09 2022] GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:10.350285 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-0cc76243-dc61-426e-832a-d894e733b41e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:10.351226 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-0cc76243-dc61-426e-832a-d894e733b41e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:10.359204 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0cc76243-dc61-426e-832a-d894e733b41e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:10.360472 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0cc76243-dc61-426e-832a-d894e733b41e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:10.361029 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0cc76243-dc61-426e-832a-d894e733b41e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:10.361736 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0cc76243-dc61-426e-832a-d894e733b41e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:10.362320 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0cc76243-dc61-426e-832a-d894e733b41e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:10.362935 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0cc76243-dc61-426e-832a-d894e733b41e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:10.476358 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-ff0a8fd4-a55f-4012-99c0-17bbfd7c42b0 req-3b67c662-b9b2-4877-922f-b0a4d73bd5ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38", "name": "network-vif-plugged", "status": "completed", "tag": "62940318-36f5-4e66-8a0a-be8fade04295"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:44:10.488510 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-ff0a8fd4-a55f-4012-99c0-17bbfd7c42b0 req-3b67c662-b9b2-4877-922f-b0a4d73bd5ce service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:10.489426 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-ff0a8fd4-a55f-4012-99c0-17bbfd7c42b0 req-3b67c662-b9b2-4877-922f-b0a4d73bd5ce service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:10.489952 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-ff0a8fd4-a55f-4012-99c0-17bbfd7c42b0 req-3b67c662-b9b2-4877-922f-b0a4d73bd5ce service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:10.503899 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-ff0a8fd4-a55f-4012-99c0-17bbfd7c42b0 req-3b67c662-b9b2-4877-922f-b0a4d73bd5ce service nova] Creating event network-vif-plugged:62940318-36f5-4e66-8a0a-be8fade04295 for instance d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 on hv-cinder-85032 Aug 07 22:44:10.509853 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-ff0a8fd4-a55f-4012-99c0-17bbfd7c42b0 req-3b67c662-b9b2-4877-922f-b0a4d73bd5ce service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040308 Aug 07 22:44:10.511182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 373/726] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:44:10.576680 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-0cc76243-dc61-426e-832a-d894e733b41e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:10.586756 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-0cc76243-dc61-426e-832a-d894e733b41e tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1577 microversion: 2.1 time: 0.241821 Aug 07 22:44:10.587948 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 354/727] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:10 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1577 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:10.801588 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-4015249a-3d64-401f-9536-cf9e22f66791 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:10.802288 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-4015249a-3d64-401f-9536-cf9e22f66791 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:10.808847 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4015249a-3d64-401f-9536-cf9e22f66791 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:10.809720 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4015249a-3d64-401f-9536-cf9e22f66791 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:10.810343 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4015249a-3d64-401f-9536-cf9e22f66791 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:10.811059 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4015249a-3d64-401f-9536-cf9e22f66791 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:10.811802 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4015249a-3d64-401f-9536-cf9e22f66791 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:10.812258 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4015249a-3d64-401f-9536-cf9e22f66791 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:10.958114 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-98c3a452-c2c9-4d94-997c-3e1dacde2801 req-1c27e102-1d61-4aa3-bd5f-6e44d185ac81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0dce4a6-327d-4d94-b3ea-a329edef8130", "tag": "c366b67b-7e71-404d-86d9-80392f670122"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:44:10.968847 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-98c3a452-c2c9-4d94-997c-3e1dacde2801 req-1c27e102-1d61-4aa3-bd5f-6e44d185ac81 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:10.969323 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-98c3a452-c2c9-4d94-997c-3e1dacde2801 req-1c27e102-1d61-4aa3-bd5f-6e44d185ac81 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:10.969747 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-98c3a452-c2c9-4d94-997c-3e1dacde2801 req-1c27e102-1d61-4aa3-bd5f-6e44d185ac81 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:10.981705 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-98c3a452-c2c9-4d94-997c-3e1dacde2801 req-1c27e102-1d61-4aa3-bd5f-6e44d185ac81 service nova] Creating event network-changed:c366b67b-7e71-404d-86d9-80392f670122 for instance b0dce4a6-327d-4d94-b3ea-a329edef8130 on hv-cinder-85032 Aug 07 22:44:10.987368 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-98c3a452-c2c9-4d94-997c-3e1dacde2801 req-1c27e102-1d61-4aa3-bd5f-6e44d185ac81 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032741 Aug 07 22:44:10.989528 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 355/728] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:44:11.052628 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-a25d656c-27c7-4e59-a125-7358a15dca8e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:11.054193 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-a25d656c-27c7-4e59-a125-7358a15dca8e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: b0dce4a6-327d-4d94-b3ea-a329edef8130] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:11.061323 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a25d656c-27c7-4e59-a125-7358a15dca8e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:11.061736 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a25d656c-27c7-4e59-a125-7358a15dca8e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:11.062169 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a25d656c-27c7-4e59-a125-7358a15dca8e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:11.062870 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a25d656c-27c7-4e59-a125-7358a15dca8e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:11.063325 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a25d656c-27c7-4e59-a125-7358a15dca8e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:11.063752 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a25d656c-27c7-4e59-a125-7358a15dca8e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:11.113506 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-4015249a-3d64-401f-9536-cf9e22f66791 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:11.128814 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-4015249a-3d64-401f-9536-cf9e22f66791 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1266 microversion: 2.1 time: 0.328300 Aug 07 22:44:11.128814 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 374/729] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:10 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1266 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:11.329849 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-a25d656c-27c7-4e59-a125-7358a15dca8e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:11.337439 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-a25d656c-27c7-4e59-a125-7358a15dca8e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130" status: 200 len: 1313 microversion: 2.1 time: 0.289724 Aug 07 22:44:11.338105 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 356/730] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:11 2022] GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:44:11.609517 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f197dba0-8c70-4bf0-b955-6ba92ed6bec2 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:11.610039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f197dba0-8c70-4bf0-b955-6ba92ed6bec2 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:11.616658 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f197dba0-8c70-4bf0-b955-6ba92ed6bec2 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:11.617160 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f197dba0-8c70-4bf0-b955-6ba92ed6bec2 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:11.617587 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f197dba0-8c70-4bf0-b955-6ba92ed6bec2 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:11.618269 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f197dba0-8c70-4bf0-b955-6ba92ed6bec2 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:11.618715 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f197dba0-8c70-4bf0-b955-6ba92ed6bec2 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:11.619131 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f197dba0-8c70-4bf0-b955-6ba92ed6bec2 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:11.759762 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-0a2de412-2f66-4c67-8785-b0b42a79d572 req-245fd60b-34d5-4525-a394-e1626513a4ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de8d1496-5f71-442d-b1b0-712a7b4f598d", "tag": "332a7e9e-deb8-4c55-afbc-6a7faca02b5e"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:44:11.769473 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-0a2de412-2f66-4c67-8785-b0b42a79d572 req-245fd60b-34d5-4525-a394-e1626513a4ae service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:11.769958 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-0a2de412-2f66-4c67-8785-b0b42a79d572 req-245fd60b-34d5-4525-a394-e1626513a4ae service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:11.770391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-0a2de412-2f66-4c67-8785-b0b42a79d572 req-245fd60b-34d5-4525-a394-e1626513a4ae service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:11.782177 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-0a2de412-2f66-4c67-8785-b0b42a79d572 req-245fd60b-34d5-4525-a394-e1626513a4ae service nova] Creating event network-changed:332a7e9e-deb8-4c55-afbc-6a7faca02b5e for instance de8d1496-5f71-442d-b1b0-712a7b4f598d on hv-cinder-85032 Aug 07 22:44:11.787080 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-0a2de412-2f66-4c67-8785-b0b42a79d572 req-245fd60b-34d5-4525-a394-e1626513a4ae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031807 Aug 07 22:44:11.788036 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 357/731] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:44:11.795095 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f197dba0-8c70-4bf0-b955-6ba92ed6bec2 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:11.802866 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f197dba0-8c70-4bf0-b955-6ba92ed6bec2 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1577 microversion: 2.1 time: 0.197203 Aug 07 22:44:11.803670 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 375/732] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:11 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1577 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:12.152458 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-93a22af6-e1e9-42c5-a23b-d60a81371b18 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:12.153943 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-93a22af6-e1e9-42c5-a23b-d60a81371b18 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:12.164450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-93a22af6-e1e9-42c5-a23b-d60a81371b18 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:12.165012 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-93a22af6-e1e9-42c5-a23b-d60a81371b18 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:12.165524 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-93a22af6-e1e9-42c5-a23b-d60a81371b18 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:12.166464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-93a22af6-e1e9-42c5-a23b-d60a81371b18 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:12.167025 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-93a22af6-e1e9-42c5-a23b-d60a81371b18 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:12.167528 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-93a22af6-e1e9-42c5-a23b-d60a81371b18 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:12.361463 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-8b60ba15-7568-4a95-9562-b894a21f32b1 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:12.362085 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-8b60ba15-7568-4a95-9562-b894a21f32b1 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: b0dce4a6-327d-4d94-b3ea-a329edef8130] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:12.370384 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8b60ba15-7568-4a95-9562-b894a21f32b1 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:12.370867 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8b60ba15-7568-4a95-9562-b894a21f32b1 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:12.371335 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8b60ba15-7568-4a95-9562-b894a21f32b1 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:12.372085 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8b60ba15-7568-4a95-9562-b894a21f32b1 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:12.372539 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8b60ba15-7568-4a95-9562-b894a21f32b1 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:12.372957 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8b60ba15-7568-4a95-9562-b894a21f32b1 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:12.393602 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-93a22af6-e1e9-42c5-a23b-d60a81371b18 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:12.406786 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-93a22af6-e1e9-42c5-a23b-d60a81371b18 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1266 microversion: 2.1 time: 0.262962 Aug 07 22:44:12.420041 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 358/733] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:12 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1266 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:12.539041 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-8b60ba15-7568-4a95-9562-b894a21f32b1 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:12.546492 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-8b60ba15-7568-4a95-9562-b894a21f32b1 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130" status: 200 len: 1313 microversion: 2.1 time: 0.192100 Aug 07 22:44:12.547066 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 376/734] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:12 2022] GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:12.824507 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ecc09bd2-d33c-4036-8d62-220d7bad8b8a tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:12.825178 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-ecc09bd2-d33c-4036-8d62-220d7bad8b8a tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:12.831369 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ecc09bd2-d33c-4036-8d62-220d7bad8b8a tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:12.832079 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ecc09bd2-d33c-4036-8d62-220d7bad8b8a tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:12.832695 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ecc09bd2-d33c-4036-8d62-220d7bad8b8a tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:12.833644 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ecc09bd2-d33c-4036-8d62-220d7bad8b8a tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:12.834338 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ecc09bd2-d33c-4036-8d62-220d7bad8b8a tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:12.834916 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ecc09bd2-d33c-4036-8d62-220d7bad8b8a tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:13.362020 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-ecc09bd2-d33c-4036-8d62-220d7bad8b8a tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:13.370706 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-ecc09bd2-d33c-4036-8d62-220d7bad8b8a tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1577 microversion: 2.1 time: 0.549978 Aug 07 22:44:13.371632 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 359/735] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:12 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1577 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:13.429809 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-9578b79c-e0a8-411e-9f36-5cd88e6876de tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:13.431139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-9578b79c-e0a8-411e-9f36-5cd88e6876de tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:13.437762 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9578b79c-e0a8-411e-9f36-5cd88e6876de tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:13.438284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9578b79c-e0a8-411e-9f36-5cd88e6876de tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:13.438721 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9578b79c-e0a8-411e-9f36-5cd88e6876de tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:13.439453 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9578b79c-e0a8-411e-9f36-5cd88e6876de tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:13.439966 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9578b79c-e0a8-411e-9f36-5cd88e6876de tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:13.440420 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9578b79c-e0a8-411e-9f36-5cd88e6876de tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:13.566903 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-4e6c7a92-3867-4d70-91ba-d22f31de7a8f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:13.567522 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-4e6c7a92-3867-4d70-91ba-d22f31de7a8f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: b0dce4a6-327d-4d94-b3ea-a329edef8130] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:13.574182 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4e6c7a92-3867-4d70-91ba-d22f31de7a8f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:13.574723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4e6c7a92-3867-4d70-91ba-d22f31de7a8f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:13.575158 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4e6c7a92-3867-4d70-91ba-d22f31de7a8f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:13.575849 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4e6c7a92-3867-4d70-91ba-d22f31de7a8f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:13.578225 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4e6c7a92-3867-4d70-91ba-d22f31de7a8f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:13.578225 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4e6c7a92-3867-4d70-91ba-d22f31de7a8f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:13.591748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-9578b79c-e0a8-411e-9f36-5cd88e6876de tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:13.599396 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-9578b79c-e0a8-411e-9f36-5cd88e6876de tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1453 microversion: 2.1 time: 0.173643 Aug 07 22:44:13.601147 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 377/736] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:13 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1453 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:13.620944 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-7822dc86-136e-4bcc-add9-84fdeb885d3e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:13.621698 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-7822dc86-136e-4bcc-add9-84fdeb885d3e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:13.630325 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7822dc86-136e-4bcc-add9-84fdeb885d3e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:13.630325 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7822dc86-136e-4bcc-add9-84fdeb885d3e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:13.630325 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7822dc86-136e-4bcc-add9-84fdeb885d3e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:13.630325 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7822dc86-136e-4bcc-add9-84fdeb885d3e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:13.630707 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7822dc86-136e-4bcc-add9-84fdeb885d3e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:13.631633 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7822dc86-136e-4bcc-add9-84fdeb885d3e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:13.766768 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-4e6c7a92-3867-4d70-91ba-d22f31de7a8f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:13.775259 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-4e6c7a92-3867-4d70-91ba-d22f31de7a8f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130" status: 200 len: 1313 microversion: 2.1 time: 0.212359 Aug 07 22:44:13.775941 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 360/737] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:13 2022] GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:44:13.800101 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-7822dc86-136e-4bcc-add9-84fdeb885d3e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:13.807749 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-7822dc86-136e-4bcc-add9-84fdeb885d3e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1453 microversion: 2.1 time: 0.190720 Aug 07 22:44:13.808343 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 378/738] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:13 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1453 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:14.394549 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-8912f493-ad98-4ced-bdba-c202028316af tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:14.395173 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-8912f493-ad98-4ced-bdba-c202028316af tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:14.403220 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8912f493-ad98-4ced-bdba-c202028316af tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:14.403946 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8912f493-ad98-4ced-bdba-c202028316af tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:14.404442 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8912f493-ad98-4ced-bdba-c202028316af tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:14.405425 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8912f493-ad98-4ced-bdba-c202028316af tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:14.405886 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8912f493-ad98-4ced-bdba-c202028316af tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:14.406313 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8912f493-ad98-4ced-bdba-c202028316af tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:14.586003 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8912f493-ad98-4ced-bdba-c202028316af tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:14.593647 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-8912f493-ad98-4ced-bdba-c202028316af tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1577 microversion: 2.1 time: 0.205132 Aug 07 22:44:14.594277 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 361/739] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:14 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1577 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:14.713188 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-cee8b3a9-bcb4-4054-a24c-0f52918dae2e tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1460737256"}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:44:14.713719 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-cee8b3a9-bcb4-4054-a24c-0f52918dae2e tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:14.720145 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cee8b3a9-bcb4-4054-a24c-0f52918dae2e tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:14.720885 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cee8b3a9-bcb4-4054-a24c-0f52918dae2e tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:14.721317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cee8b3a9-bcb4-4054-a24c-0f52918dae2e tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:14.722005 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cee8b3a9-bcb4-4054-a24c-0f52918dae2e tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:14.722456 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cee8b3a9-bcb4-4054-a24c-0f52918dae2e tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:14.722877 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cee8b3a9-bcb4-4054-a24c-0f52918dae2e tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:14.796849 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-e8d352fc-9157-4c06-8807-e66f36322235 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:14.797783 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-e8d352fc-9157-4c06-8807-e66f36322235 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: b0dce4a6-327d-4d94-b3ea-a329edef8130] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:14.804492 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e8d352fc-9157-4c06-8807-e66f36322235 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:14.805056 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e8d352fc-9157-4c06-8807-e66f36322235 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:14.805718 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e8d352fc-9157-4c06-8807-e66f36322235 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:14.806521 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e8d352fc-9157-4c06-8807-e66f36322235 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:14.807188 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e8d352fc-9157-4c06-8807-e66f36322235 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:14.807954 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e8d352fc-9157-4c06-8807-e66f36322235 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:14.865765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.network.security_group_api [None req-cee8b3a9-bcb4-4054-a24c-0f52918dae2e tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Adding security group a645b010-16ef-446e-8d5a-b6ead42b3e84 to port 332a7e9e-deb8-4c55-afbc-6a7faca02b5e Aug 07 22:44:14.914571 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=2 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:44:15.040336 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-e8d352fc-9157-4c06-8807-e66f36322235 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:15.048804 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-e8d352fc-9157-4c06-8807-e66f36322235 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130" status: 200 len: 1313 microversion: 2.1 time: 0.255822 Aug 07 22:44:15.049376 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 362/740] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:14 2022] GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130 => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:44:15.330931 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-cee8b3a9-bcb4-4054-a24c-0f52918dae2e tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "POST /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d/action" status: 202 len: 0 microversion: 2.1 time: 0.621943 Aug 07 22:44:15.331810 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 379/741] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 22:44:14 2022] POST /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d/action => generated 0 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:44:15.338640 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-703c3352-0f55-4a8a-8495-0393f2a22d6e req-db8dfc56-d086-406a-b5e9-d7680a32754c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de8d1496-5f71-442d-b1b0-712a7b4f598d", "tag": "332a7e9e-deb8-4c55-afbc-6a7faca02b5e"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:44:15.347631 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=8 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:44:15.352866 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f53d886e-4034-4ae0-b848-eeb0e0fb5ddf tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:15.353570 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f53d886e-4034-4ae0-b848-eeb0e0fb5ddf tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:15.373790 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f53d886e-4034-4ae0-b848-eeb0e0fb5ddf tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:15.374622 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f53d886e-4034-4ae0-b848-eeb0e0fb5ddf tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:15.374742 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f53d886e-4034-4ae0-b848-eeb0e0fb5ddf tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:15.375403 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f53d886e-4034-4ae0-b848-eeb0e0fb5ddf tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:15.375849 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f53d886e-4034-4ae0-b848-eeb0e0fb5ddf tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:15.376299 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f53d886e-4034-4ae0-b848-eeb0e0fb5ddf tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:15.381009 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-703c3352-0f55-4a8a-8495-0393f2a22d6e req-db8dfc56-d086-406a-b5e9-d7680a32754c service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:15.381839 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-703c3352-0f55-4a8a-8495-0393f2a22d6e req-db8dfc56-d086-406a-b5e9-d7680a32754c service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:15.382119 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-703c3352-0f55-4a8a-8495-0393f2a22d6e req-db8dfc56-d086-406a-b5e9-d7680a32754c service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:15.411966 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-703c3352-0f55-4a8a-8495-0393f2a22d6e req-db8dfc56-d086-406a-b5e9-d7680a32754c service nova] Creating event network-changed:332a7e9e-deb8-4c55-afbc-6a7faca02b5e for instance de8d1496-5f71-442d-b1b0-712a7b4f598d on hv-cinder-85032 Aug 07 22:44:15.418950 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-703c3352-0f55-4a8a-8495-0393f2a22d6e req-db8dfc56-d086-406a-b5e9-d7680a32754c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083179 Aug 07 22:44:15.426386 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 363/742] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:44:15.615345 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-c7e6187c-eb32-414c-89fa-3c7fec40771c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:15.616454 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-c7e6187c-eb32-414c-89fa-3c7fec40771c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:15.623616 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c7e6187c-eb32-414c-89fa-3c7fec40771c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:15.624524 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c7e6187c-eb32-414c-89fa-3c7fec40771c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:15.625220 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c7e6187c-eb32-414c-89fa-3c7fec40771c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:15.626141 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c7e6187c-eb32-414c-89fa-3c7fec40771c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:15.626819 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c7e6187c-eb32-414c-89fa-3c7fec40771c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:15.627456 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c7e6187c-eb32-414c-89fa-3c7fec40771c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:15.666916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f53d886e-4034-4ae0-b848-eeb0e0fb5ddf tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:15.688748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f53d886e-4034-4ae0-b848-eeb0e0fb5ddf tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1760 microversion: 2.1 time: 0.344442 Aug 07 22:44:15.700141 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 380/743] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:15 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1760 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:15.852923 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-c7e6187c-eb32-414c-89fa-3c7fec40771c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:15.865942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-c7e6187c-eb32-414c-89fa-3c7fec40771c tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1577 microversion: 2.1 time: 0.253567 Aug 07 22:44:15.877171 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 364/744] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:15 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1577 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:44:16.071276 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-c6a2a1ee-9eed-4add-9e34-970590cadc6c tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:16.072553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-c6a2a1ee-9eed-4add-9e34-970590cadc6c tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: b0dce4a6-327d-4d94-b3ea-a329edef8130] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:16.080682 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c6a2a1ee-9eed-4add-9e34-970590cadc6c tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:16.081134 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-36f6fcc5-cfd6-4b97-beca-40cdc6adb68b req-3114253a-99f9-4bd9-987b-22533e37ce7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38", "tag": "62940318-36f5-4e66-8a0a-be8fade04295"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:44:16.081952 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c6a2a1ee-9eed-4add-9e34-970590cadc6c tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:16.082498 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c6a2a1ee-9eed-4add-9e34-970590cadc6c tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:16.083324 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c6a2a1ee-9eed-4add-9e34-970590cadc6c tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:16.083943 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c6a2a1ee-9eed-4add-9e34-970590cadc6c tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:16.084714 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c6a2a1ee-9eed-4add-9e34-970590cadc6c tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:16.102437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-36f6fcc5-cfd6-4b97-beca-40cdc6adb68b req-3114253a-99f9-4bd9-987b-22533e37ce7d service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:16.102920 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-36f6fcc5-cfd6-4b97-beca-40cdc6adb68b req-3114253a-99f9-4bd9-987b-22533e37ce7d service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:16.103355 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-36f6fcc5-cfd6-4b97-beca-40cdc6adb68b req-3114253a-99f9-4bd9-987b-22533e37ce7d service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:16.117156 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-36f6fcc5-cfd6-4b97-beca-40cdc6adb68b req-3114253a-99f9-4bd9-987b-22533e37ce7d service nova] Creating event network-changed:62940318-36f5-4e66-8a0a-be8fade04295 for instance d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 on hv-cinder-85032 Aug 07 22:44:16.122531 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-36f6fcc5-cfd6-4b97-beca-40cdc6adb68b req-3114253a-99f9-4bd9-987b-22533e37ce7d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045937 Aug 07 22:44:16.123758 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 365/745] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:44:16.284632 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-c6a2a1ee-9eed-4add-9e34-970590cadc6c tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:16.293699 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-c6a2a1ee-9eed-4add-9e34-970590cadc6c tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130" status: 200 len: 1313 microversion: 2.1 time: 0.227040 Aug 07 22:44:16.294275 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 381/746] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:16 2022] GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:16.889827 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-3485bb94-1e33-4c6a-88b3-f174a3268559 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:16.890553 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-3485bb94-1e33-4c6a-88b3-f174a3268559 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:16.897377 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3485bb94-1e33-4c6a-88b3-f174a3268559 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:16.897858 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3485bb94-1e33-4c6a-88b3-f174a3268559 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:16.898414 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3485bb94-1e33-4c6a-88b3-f174a3268559 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:16.899119 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3485bb94-1e33-4c6a-88b3-f174a3268559 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:16.899572 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3485bb94-1e33-4c6a-88b3-f174a3268559 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:16.899998 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3485bb94-1e33-4c6a-88b3-f174a3268559 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:17.042434 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-3485bb94-1e33-4c6a-88b3-f174a3268559 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:17.050009 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-3485bb94-1e33-4c6a-88b3-f174a3268559 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1577 microversion: 2.1 time: 0.166456 Aug 07 22:44:17.050575 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 366/747] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:16 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:17.314768 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f15475e7-6952-42cd-a3ea-a35736634a9e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:17.315443 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f15475e7-6952-42cd-a3ea-a35736634a9e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: b0dce4a6-327d-4d94-b3ea-a329edef8130] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:17.322319 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f15475e7-6952-42cd-a3ea-a35736634a9e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:17.322999 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f15475e7-6952-42cd-a3ea-a35736634a9e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:17.323439 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f15475e7-6952-42cd-a3ea-a35736634a9e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:17.324244 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f15475e7-6952-42cd-a3ea-a35736634a9e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:17.324702 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f15475e7-6952-42cd-a3ea-a35736634a9e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:17.325126 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f15475e7-6952-42cd-a3ea-a35736634a9e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:17.467784 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f15475e7-6952-42cd-a3ea-a35736634a9e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:17.475245 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f15475e7-6952-42cd-a3ea-a35736634a9e tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130" status: 200 len: 1313 microversion: 2.1 time: 0.164396 Aug 07 22:44:17.475832 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 382/748] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:17 2022] GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:18.073149 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-dce71245-8a36-47a1-868e-1bd051ff6db2 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:18.073793 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-dce71245-8a36-47a1-868e-1bd051ff6db2 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:18.080560 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-dce71245-8a36-47a1-868e-1bd051ff6db2 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:18.081037 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-dce71245-8a36-47a1-868e-1bd051ff6db2 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:18.081462 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-dce71245-8a36-47a1-868e-1bd051ff6db2 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:18.082140 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-dce71245-8a36-47a1-868e-1bd051ff6db2 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:18.082588 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-dce71245-8a36-47a1-868e-1bd051ff6db2 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:18.083006 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-dce71245-8a36-47a1-868e-1bd051ff6db2 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:18.213639 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-dce71245-8a36-47a1-868e-1bd051ff6db2 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:18.221250 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-dce71245-8a36-47a1-868e-1bd051ff6db2 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1577 microversion: 2.1 time: 0.153383 Aug 07 22:44:18.221823 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 367/749] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:18 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:18.496460 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-7d04eeb2-0cef-4101-b2ee-6fb7b28897f7 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:18.497142 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-7d04eeb2-0cef-4101-b2ee-6fb7b28897f7 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: b0dce4a6-327d-4d94-b3ea-a329edef8130] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:18.503606 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7d04eeb2-0cef-4101-b2ee-6fb7b28897f7 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:18.504123 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7d04eeb2-0cef-4101-b2ee-6fb7b28897f7 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:18.504560 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7d04eeb2-0cef-4101-b2ee-6fb7b28897f7 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:18.505255 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7d04eeb2-0cef-4101-b2ee-6fb7b28897f7 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:18.505740 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7d04eeb2-0cef-4101-b2ee-6fb7b28897f7 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:18.509300 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7d04eeb2-0cef-4101-b2ee-6fb7b28897f7 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:18.524492 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=100 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:44:18.626465 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-add01366-3c3b-4dfd-b96c-4b0f21113a7e req-91e5fd9e-8c39-4201-b10d-7ce1fb2ba506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0dce4a6-327d-4d94-b3ea-a329edef8130", "name": "network-vif-plugged", "status": "completed", "tag": "c366b67b-7e71-404d-86d9-80392f670122"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:44:18.637258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-add01366-3c3b-4dfd-b96c-4b0f21113a7e req-91e5fd9e-8c39-4201-b10d-7ce1fb2ba506 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:18.637840 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-add01366-3c3b-4dfd-b96c-4b0f21113a7e req-91e5fd9e-8c39-4201-b10d-7ce1fb2ba506 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:18.638439 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-add01366-3c3b-4dfd-b96c-4b0f21113a7e req-91e5fd9e-8c39-4201-b10d-7ce1fb2ba506 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:18.644833 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-7d04eeb2-0cef-4101-b2ee-6fb7b28897f7 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:18.650657 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-add01366-3c3b-4dfd-b96c-4b0f21113a7e req-91e5fd9e-8c39-4201-b10d-7ce1fb2ba506 service nova] Creating event network-vif-plugged:c366b67b-7e71-404d-86d9-80392f670122 for instance b0dce4a6-327d-4d94-b3ea-a329edef8130 on hv-cinder-85032 Aug 07 22:44:18.654202 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-7d04eeb2-0cef-4101-b2ee-6fb7b28897f7 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130" status: 200 len: 1313 microversion: 2.1 time: 0.161522 Aug 07 22:44:18.654889 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 383/750] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:18 2022] GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:18.655652 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-add01366-3c3b-4dfd-b96c-4b0f21113a7e req-91e5fd9e-8c39-4201-b10d-7ce1fb2ba506 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032994 Aug 07 22:44:18.656551 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 368/751] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:44:19.242389 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-c65a77cc-5197-41ab-938d-61dd98b39dc0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:19.242993 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-c65a77cc-5197-41ab-938d-61dd98b39dc0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:19.253115 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c65a77cc-5197-41ab-938d-61dd98b39dc0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:19.253590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c65a77cc-5197-41ab-938d-61dd98b39dc0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:19.254020 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c65a77cc-5197-41ab-938d-61dd98b39dc0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:19.254718 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c65a77cc-5197-41ab-938d-61dd98b39dc0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:19.255172 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c65a77cc-5197-41ab-938d-61dd98b39dc0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:19.256111 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c65a77cc-5197-41ab-938d-61dd98b39dc0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:19.390298 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-c65a77cc-5197-41ab-938d-61dd98b39dc0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:19.398611 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-c65a77cc-5197-41ab-938d-61dd98b39dc0 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1577 microversion: 2.1 time: 0.160175 Aug 07 22:44:19.399173 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 384/752] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:19 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:19.676515 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ee938073-9ea5-4645-92e9-98af738f8c30 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:19.677214 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-ee938073-9ea5-4645-92e9-98af738f8c30 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: b0dce4a6-327d-4d94-b3ea-a329edef8130] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:19.684158 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ee938073-9ea5-4645-92e9-98af738f8c30 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:19.684637 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ee938073-9ea5-4645-92e9-98af738f8c30 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:19.685077 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ee938073-9ea5-4645-92e9-98af738f8c30 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:19.685760 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ee938073-9ea5-4645-92e9-98af738f8c30 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:19.686214 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ee938073-9ea5-4645-92e9-98af738f8c30 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:19.686638 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ee938073-9ea5-4645-92e9-98af738f8c30 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:19.814198 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-ee938073-9ea5-4645-92e9-98af738f8c30 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:19.821826 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-ee938073-9ea5-4645-92e9-98af738f8c30 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130" status: 200 len: 1313 microversion: 2.1 time: 0.150057 Aug 07 22:44:19.822582 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 369/753] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:19 2022] GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:20.420363 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-8a48b183-f9d6-471e-bb47-8c25d436fa46 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:20.420974 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-8a48b183-f9d6-471e-bb47-8c25d436fa46 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:20.427336 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8a48b183-f9d6-471e-bb47-8c25d436fa46 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:20.428344 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8a48b183-f9d6-471e-bb47-8c25d436fa46 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:20.428792 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8a48b183-f9d6-471e-bb47-8c25d436fa46 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:20.429487 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8a48b183-f9d6-471e-bb47-8c25d436fa46 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:20.429943 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8a48b183-f9d6-471e-bb47-8c25d436fa46 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:20.430367 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8a48b183-f9d6-471e-bb47-8c25d436fa46 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:20.566885 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-8a48b183-f9d6-471e-bb47-8c25d436fa46 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:20.574755 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-8a48b183-f9d6-471e-bb47-8c25d436fa46 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1577 microversion: 2.1 time: 0.158208 Aug 07 22:44:20.575297 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 385/754] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:20 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:20.673719 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-fb751137-b6f3-4b59-abbf-1b7d2bfeccfe req-62f00fcc-03bb-4478-b9b4-e1de318becdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93991d13-4c43-4e03-9031-2d5032989994", "name": "network-vif-plugged", "status": "completed", "tag": "2b5b8b0f-84c3-482a-be06-dd81e2a229e1"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:44:20.683686 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-fb751137-b6f3-4b59-abbf-1b7d2bfeccfe req-62f00fcc-03bb-4478-b9b4-e1de318becdd service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:20.684315 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-fb751137-b6f3-4b59-abbf-1b7d2bfeccfe req-62f00fcc-03bb-4478-b9b4-e1de318becdd service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:20.684614 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-fb751137-b6f3-4b59-abbf-1b7d2bfeccfe req-62f00fcc-03bb-4478-b9b4-e1de318becdd service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:20.696647 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-fb751137-b6f3-4b59-abbf-1b7d2bfeccfe req-62f00fcc-03bb-4478-b9b4-e1de318becdd service nova] Creating event network-vif-plugged:2b5b8b0f-84c3-482a-be06-dd81e2a229e1 for instance 93991d13-4c43-4e03-9031-2d5032989994 on hv-cinder-85032 Aug 07 22:44:20.701680 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-fb751137-b6f3-4b59-abbf-1b7d2bfeccfe req-62f00fcc-03bb-4478-b9b4-e1de318becdd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031635 Aug 07 22:44:20.702358 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 370/755] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:44:20.842681 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-0b2b2ddc-20c4-421a-9d11-74f4a222c974 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:20.843285 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-0b2b2ddc-20c4-421a-9d11-74f4a222c974 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: b0dce4a6-327d-4d94-b3ea-a329edef8130] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:20.849268 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0b2b2ddc-20c4-421a-9d11-74f4a222c974 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:20.850115 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0b2b2ddc-20c4-421a-9d11-74f4a222c974 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:20.850615 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0b2b2ddc-20c4-421a-9d11-74f4a222c974 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:20.851498 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0b2b2ddc-20c4-421a-9d11-74f4a222c974 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:20.851954 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0b2b2ddc-20c4-421a-9d11-74f4a222c974 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:20.859734 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0b2b2ddc-20c4-421a-9d11-74f4a222c974 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:20.985485 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-0b2b2ddc-20c4-421a-9d11-74f4a222c974 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:20.993655 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-0b2b2ddc-20c4-421a-9d11-74f4a222c974 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130" status: 200 len: 1498 microversion: 2.1 time: 0.154868 Aug 07 22:44:20.994238 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 386/756] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:20 2022] GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130 => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:21.596484 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-52b0bd13-1b93-454f-a8af-ece5ebbf4a36 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:21.597188 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-52b0bd13-1b93-454f-a8af-ece5ebbf4a36 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:21.603598 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-52b0bd13-1b93-454f-a8af-ece5ebbf4a36 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:21.604114 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-52b0bd13-1b93-454f-a8af-ece5ebbf4a36 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:21.604585 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-52b0bd13-1b93-454f-a8af-ece5ebbf4a36 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:21.605277 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-52b0bd13-1b93-454f-a8af-ece5ebbf4a36 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:21.605736 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-52b0bd13-1b93-454f-a8af-ece5ebbf4a36 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:21.606163 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-52b0bd13-1b93-454f-a8af-ece5ebbf4a36 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:21.742329 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-52b0bd13-1b93-454f-a8af-ece5ebbf4a36 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:21.749965 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-52b0bd13-1b93-454f-a8af-ece5ebbf4a36 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1577 microversion: 2.1 time: 0.157783 Aug 07 22:44:21.750523 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 371/757] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:21 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:21.773782 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-5f679f15-45d9-40a3-baf6-9eb394b8a943 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:21.774321 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-5f679f15-45d9-40a3-baf6-9eb394b8a943 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: b0dce4a6-327d-4d94-b3ea-a329edef8130] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:21.780659 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5f679f15-45d9-40a3-baf6-9eb394b8a943 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:21.781140 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5f679f15-45d9-40a3-baf6-9eb394b8a943 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:21.781580 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5f679f15-45d9-40a3-baf6-9eb394b8a943 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:21.782293 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5f679f15-45d9-40a3-baf6-9eb394b8a943 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:21.782750 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5f679f15-45d9-40a3-baf6-9eb394b8a943 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:21.783180 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5f679f15-45d9-40a3-baf6-9eb394b8a943 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:21.808088 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-5f679f15-45d9-40a3-baf6-9eb394b8a943 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: b0dce4a6-327d-4d94-b3ea-a329edef8130] Going to try to terminate instance {{(pid=129964) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 22:44:22.057337 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-5f679f15-45d9-40a3-baf6-9eb394b8a943 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130" status: 204 len: 0 microversion: 2.1 time: 0.287143 Aug 07 22:44:22.057919 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 387/758] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:44:21 2022] DELETE /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 22:44:22.066083 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-b8ccffa2-55d1-4057-a87c-95b57627c2ab tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:22.066703 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-b8ccffa2-55d1-4057-a87c-95b57627c2ab tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: b0dce4a6-327d-4d94-b3ea-a329edef8130] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:22.073067 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b8ccffa2-55d1-4057-a87c-95b57627c2ab tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:22.073556 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b8ccffa2-55d1-4057-a87c-95b57627c2ab tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:22.074000 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b8ccffa2-55d1-4057-a87c-95b57627c2ab tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:22.074712 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b8ccffa2-55d1-4057-a87c-95b57627c2ab tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:22.075239 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b8ccffa2-55d1-4057-a87c-95b57627c2ab tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:22.075624 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b8ccffa2-55d1-4057-a87c-95b57627c2ab tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:22.079753 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=100 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:44:22.207773 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-b8ccffa2-55d1-4057-a87c-95b57627c2ab tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:22.215106 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-b8ccffa2-55d1-4057-a87c-95b57627c2ab tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130" status: 200 len: 1504 microversion: 2.1 time: 0.152982 Aug 07 22:44:22.215667 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 372/759] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:22 2022] GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:22.774271 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-50052df0-c700-48be-802d-89e1b55795f9 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:22.774962 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-50052df0-c700-48be-802d-89e1b55795f9 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:22.781347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-50052df0-c700-48be-802d-89e1b55795f9 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:22.781819 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-50052df0-c700-48be-802d-89e1b55795f9 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:22.782248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-50052df0-c700-48be-802d-89e1b55795f9 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:22.782917 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-50052df0-c700-48be-802d-89e1b55795f9 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:22.783458 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-50052df0-c700-48be-802d-89e1b55795f9 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:22.783873 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-50052df0-c700-48be-802d-89e1b55795f9 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:22.914818 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-50052df0-c700-48be-802d-89e1b55795f9 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:22.922490 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-50052df0-c700-48be-802d-89e1b55795f9 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1577 microversion: 2.1 time: 0.153222 Aug 07 22:44:22.923052 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 388/760] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:22 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:23.236405 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-2383c1a4-82ea-43b4-bee3-43e682b38d43 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:23.237020 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-2383c1a4-82ea-43b4-bee3-43e682b38d43 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: b0dce4a6-327d-4d94-b3ea-a329edef8130] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:23.243991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2383c1a4-82ea-43b4-bee3-43e682b38d43 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:23.244502 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2383c1a4-82ea-43b4-bee3-43e682b38d43 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:23.244938 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2383c1a4-82ea-43b4-bee3-43e682b38d43 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:23.245617 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2383c1a4-82ea-43b4-bee3-43e682b38d43 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:23.246067 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2383c1a4-82ea-43b4-bee3-43e682b38d43 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:23.246490 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2383c1a4-82ea-43b4-bee3-43e682b38d43 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:23.376317 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-2383c1a4-82ea-43b4-bee3-43e682b38d43 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:23.384245 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-2383c1a4-82ea-43b4-bee3-43e682b38d43 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130" status: 200 len: 1504 microversion: 2.1 time: 0.151724 Aug 07 22:44:23.384804 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 373/761] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:23 2022] GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:23.943524 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-c7d8a902-07df-42a5-85ad-d9255ea9dac8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:23.944165 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-c7d8a902-07df-42a5-85ad-d9255ea9dac8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:23.950871 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c7d8a902-07df-42a5-85ad-d9255ea9dac8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:23.951340 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c7d8a902-07df-42a5-85ad-d9255ea9dac8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:23.951764 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c7d8a902-07df-42a5-85ad-d9255ea9dac8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:23.952473 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c7d8a902-07df-42a5-85ad-d9255ea9dac8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:23.952921 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c7d8a902-07df-42a5-85ad-d9255ea9dac8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:23.953335 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c7d8a902-07df-42a5-85ad-d9255ea9dac8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:24.085703 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-c7d8a902-07df-42a5-85ad-d9255ea9dac8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:24.093887 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-c7d8a902-07df-42a5-85ad-d9255ea9dac8 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1564 microversion: 2.1 time: 0.154396 Aug 07 22:44:24.094447 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 389/762] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:23 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:24.406533 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-3ce98b24-b8c1-4bc4-92e0-052e4ae640db tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:24.407140 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-3ce98b24-b8c1-4bc4-92e0-052e4ae640db tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: b0dce4a6-327d-4d94-b3ea-a329edef8130] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:24.413407 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3ce98b24-b8c1-4bc4-92e0-052e4ae640db tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:24.413916 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3ce98b24-b8c1-4bc4-92e0-052e4ae640db tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:24.414319 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3ce98b24-b8c1-4bc4-92e0-052e4ae640db tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:24.415000 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3ce98b24-b8c1-4bc4-92e0-052e4ae640db tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:24.415452 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3ce98b24-b8c1-4bc4-92e0-052e4ae640db tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:24.415872 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3ce98b24-b8c1-4bc4-92e0-052e4ae640db tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:24.551242 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-3ce98b24-b8c1-4bc4-92e0-052e4ae640db tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:24.559226 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-3ce98b24-b8c1-4bc4-92e0-052e4ae640db tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130" status: 200 len: 1504 microversion: 2.1 time: 0.156547 Aug 07 22:44:24.559837 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 374/763] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:24 2022] GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:24.646293 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-0a8e8d0d-3482-4824-b07c-8f81bf146fef req-03286f5e-c282-40ed-8a9f-647d8ecaf457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0dce4a6-327d-4d94-b3ea-a329edef8130", "name": "network-vif-deleted", "tag": "c366b67b-7e71-404d-86d9-80392f670122"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:44:24.655673 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-0a8e8d0d-3482-4824-b07c-8f81bf146fef req-03286f5e-c282-40ed-8a9f-647d8ecaf457 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:24.656154 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-0a8e8d0d-3482-4824-b07c-8f81bf146fef req-03286f5e-c282-40ed-8a9f-647d8ecaf457 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:24.656578 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-0a8e8d0d-3482-4824-b07c-8f81bf146fef req-03286f5e-c282-40ed-8a9f-647d8ecaf457 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:24.667108 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-0a8e8d0d-3482-4824-b07c-8f81bf146fef req-03286f5e-c282-40ed-8a9f-647d8ecaf457 service nova] Creating event network-vif-deleted:c366b67b-7e71-404d-86d9-80392f670122 for instance b0dce4a6-327d-4d94-b3ea-a329edef8130 on hv-cinder-85032 Aug 07 22:44:24.671780 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-0a8e8d0d-3482-4824-b07c-8f81bf146fef req-03286f5e-c282-40ed-8a9f-647d8ecaf457 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029145 Aug 07 22:44:24.672384 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 390/764] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:44:25.581068 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-5852621b-eeb5-4507-97ce-14d6b9396cbd tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:25.581677 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-5852621b-eeb5-4507-97ce-14d6b9396cbd tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: b0dce4a6-327d-4d94-b3ea-a329edef8130] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:25.588711 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5852621b-eeb5-4507-97ce-14d6b9396cbd tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:25.589193 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5852621b-eeb5-4507-97ce-14d6b9396cbd tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:25.589626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5852621b-eeb5-4507-97ce-14d6b9396cbd tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:25.590309 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5852621b-eeb5-4507-97ce-14d6b9396cbd tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:25.590760 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5852621b-eeb5-4507-97ce-14d6b9396cbd tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:25.591183 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5852621b-eeb5-4507-97ce-14d6b9396cbd tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:25.622372 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5852621b-eeb5-4507-97ce-14d6b9396cbd tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:25.622856 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5852621b-eeb5-4507-97ce-14d6b9396cbd tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:25.623297 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5852621b-eeb5-4507-97ce-14d6b9396cbd tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:25.623741 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.objects.instance [None req-5852621b-eeb5-4507-97ce-14d6b9396cbd tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lazy-loading 'fault' on Instance uuid b0dce4a6-327d-4d94-b3ea-a329edef8130 {{(pid=129965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:44:25.665470 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-5852621b-eeb5-4507-97ce-14d6b9396cbd tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:25.672566 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-5852621b-eeb5-4507-97ce-14d6b9396cbd tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130" status: 200 len: 1303 microversion: 2.1 time: 0.095381 Aug 07 22:44:25.674889 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 375/765] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:25 2022] GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:26.694700 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b02331a9-b18b-40f0-8aa6-224cf8826721 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:26.695476 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-b02331a9-b18b-40f0-8aa6-224cf8826721 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: b0dce4a6-327d-4d94-b3ea-a329edef8130] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:26.701600 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b02331a9-b18b-40f0-8aa6-224cf8826721 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:26.702078 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b02331a9-b18b-40f0-8aa6-224cf8826721 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:26.702511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b02331a9-b18b-40f0-8aa6-224cf8826721 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:26.703195 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b02331a9-b18b-40f0-8aa6-224cf8826721 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:26.703644 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b02331a9-b18b-40f0-8aa6-224cf8826721 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:26.704091 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b02331a9-b18b-40f0-8aa6-224cf8826721 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:26.718899 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-b02331a9-b18b-40f0-8aa6-224cf8826721 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] HTTP exception thrown: Instance b0dce4a6-327d-4d94-b3ea-a329edef8130 could not be found. Aug 07 22:44:26.720533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b02331a9-b18b-40f0-8aa6-224cf8826721 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Request method failure captured: Aug 07 22:44:26.720533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130 HTTP/1.1 Aug 07 22:44:26.720533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:44:26.720533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:44:26.720533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:44:26.720533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:44:26.720533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:44:26.720533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:44:26.720533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:44:26.720533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:44:26.720533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8EAy9yDP4b-R9T-9T7UXWC61ly9Nez7NHfkehAH-Nxh9tEcQohm21v5rhjC_H_IxNZFTIo4UcnP5Kz0PHHk454gQGp5s1hGG2Je8aDxxvaBKA8QMburS6R_dfDyKacmw3kOj74Ru8AFLKiIt7CenyOfXUb9t5IUL-GrKL2S46pDjrpw Aug 07 22:44:26.720533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:44:26.720533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:44:26.720533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:44:26.720533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:44:26.720533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:44:26.720533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:44:26.720533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 2648957a96504832a5693026f9d99c58 Aug 07 22:44:26.720533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-VolumesActionsTest-1542252996 Aug 07 22:44:26.720533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:44:26.720533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:44:26.722244 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2648957a96504832a5693026f9d99c58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2648957a96504832a5693026f9d99c58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2648957a96504832a5693026f9d99c58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2648957a96504832a5693026f9d99c58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:44:26.722244 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-VolumesActionsTest-1542252996 Aug 07 22:44:26.722244 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 2648957a96504832a5693026f9d99c58 Aug 07 22:44:26.722244 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-VolumesActionsTest-1542252996 Aug 07 22:44:26.722244 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-VolumesActionsTest-1542252996-project Aug 07 22:44:26.722244 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:44:26.722244 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:44:26.722244 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: 269193a67b504842b3858022b378ae2a Aug 07 22:44:26.722244 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-VolumesActionsTest-1542252996-project Aug 07 22:44:26.722244 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: > Aug 07 22:44:26.722244 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Instance b0dce4a6-327d-4d94-b3ea-a329edef8130 could not be found. Aug 07 22:44:26.722244 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': 'b0dce4a6-327d-4d94-b3ea-a329edef8130'} Aug 07 22:44:26.723279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:44:26.723279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:44:26.723279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:44:26.723279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:44:26.723279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:44:26.723279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:44:26.723279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:44:26.723279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:44:26.723279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:44:26.723279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:44:26.723279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0dce4a6-327d-4d94-b3ea-a329edef8130 could not be found. Aug 07 22:44:26.723279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:44:26.723279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:44:26.723279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:44:26.723279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:44:26.723279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:44:26.723279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:44:26.723279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:44:26.723279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:44:26.723279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:44:26.724906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:44:26.724906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:44:26.724906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:44:26.724906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:44:26.724906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:44:26.724906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:44:26.724906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:44:26.724906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0dce4a6-327d-4d94-b3ea-a329edef8130 could not be found. Aug 07 22:44:26.724906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:44:26.724906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:44:26.724906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:44:26.724906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:44:26.724906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:44:26.724906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:44:26.724906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:44:26.724906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:44:26.724906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0dce4a6-327d-4d94-b3ea-a329edef8130 could not be found. Aug 07 22:44:26.724906 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:44:26.727046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b02331a9-b18b-40f0-8aa6-224cf8826721 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Returning 404 to user: Instance b0dce4a6-327d-4d94-b3ea-a329edef8130 could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:44:26.727046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-b02331a9-b18b-40f0-8aa6-224cf8826721 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130" status: 404 len: 111 microversion: 2.1 time: 0.032101 Aug 07 22:44:26.727046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 391/766] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:26 2022] GET /compute/v2.1/servers/b0dce4a6-327d-4d94-b3ea-a329edef8130 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:44:26.772158 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-4d5825e2-7305-414e-a5a0-98aa894469c9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-44423876", "imageRef": "91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8", "flavorRef": "452", "networks": [{"uuid": "68262f02-e373-4d41-8919-e2f8b833fcb3"}]}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:44:26.824532 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.network.neutron [None req-4d5825e2-7305-414e-a5a0-98aa894469c9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] validate_networks() for [('68262f02-e373-4d41-8919-e2f8b833fcb3', None, None, None, None, None)] {{(pid=129965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 22:44:27.164522 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-4d5825e2-7305-414e-a5a0-98aa894469c9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Flavor limits 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 22:44:27.164955 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-4d5825e2-7305-414e-a5a0-98aa894469c9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Image limits 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 22:44:27.165428 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-4d5825e2-7305-414e-a5a0-98aa894469c9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Flavor pref 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 22:44:27.165837 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-4d5825e2-7305-414e-a5a0-98aa894469c9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Image pref 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 22:44:27.166254 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-4d5825e2-7305-414e-a5a0-98aa894469c9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 22:44:27.174833 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4d5825e2-7305-414e-a5a0-98aa894469c9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:27.175318 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4d5825e2-7305-414e-a5a0-98aa894469c9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:27.175750 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4d5825e2-7305-414e-a5a0-98aa894469c9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:27.176515 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4d5825e2-7305-414e-a5a0-98aa894469c9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:27.176971 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4d5825e2-7305-414e-a5a0-98aa894469c9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:27.177396 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4d5825e2-7305-414e-a5a0-98aa894469c9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:27.194143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-4d5825e2-7305-414e-a5a0-98aa894469c9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Getting quotas for project 2648957a96504832a5693026f9d99c58. Resources: {'cores', 'instances', 'ram'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:44:27.198860 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-4d5825e2-7305-414e-a5a0-98aa894469c9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Getting quotas for user 269193a67b504842b3858022b378ae2a and project 2648957a96504832a5693026f9d99c58. Resources: {'cores', 'instances', 'ram'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:44:27.210343 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-4d5825e2-7305-414e-a5a0-98aa894469c9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Going to run 1 instances... {{(pid=129965) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 22:44:27.212747 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-4d5825e2-7305-414e-a5a0-98aa894469c9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 22:44:27.341983 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-4d5825e2-7305-414e-a5a0-98aa894469c9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573536 Aug 07 22:44:27.342542 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 376/767] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 22:44:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 22:44:27.353781 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-bb5af227-e7b3-4b79-8f37-1fca8cf3f8c3 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:27.354398 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-bb5af227-e7b3-4b79-8f37-1fca8cf3f8c3 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:27.410379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-bb5af227-e7b3-4b79-8f37-1fca8cf3f8c3 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:27.418312 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-bb5af227-e7b3-4b79-8f37-1fca8cf3f8c3 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c" status: 200 len: 1212 microversion: 2.1 time: 0.068441 Aug 07 22:44:27.418312 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 392/768] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:27 2022] GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c => generated 1212 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:27.728943 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-47e4f9d7-0ee0-4b95-86bc-2bcedef4a905 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:44:27.731233 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-47e4f9d7-0ee0-4b95-86bc-2bcedef4a905 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:27.738149 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-47e4f9d7-0ee0-4b95-86bc-2bcedef4a905 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:27.738727 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-47e4f9d7-0ee0-4b95-86bc-2bcedef4a905 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:27.739162 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-47e4f9d7-0ee0-4b95-86bc-2bcedef4a905 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:27.739852 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-47e4f9d7-0ee0-4b95-86bc-2bcedef4a905 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:27.740351 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-47e4f9d7-0ee0-4b95-86bc-2bcedef4a905 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:27.740773 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-47e4f9d7-0ee0-4b95-86bc-2bcedef4a905 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:27.952625 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-47e4f9d7-0ee0-4b95-86bc-2bcedef4a905 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "POST /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d/action" status: 202 len: 0 microversion: 2.1 time: 0.227453 Aug 07 22:44:27.953258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 377/769] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 22:44:27 2022] POST /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:44:27.962496 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-aa266552-ee17-4ca3-a82a-7ca407eed3d4 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:27.963099 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-aa266552-ee17-4ca3-a82a-7ca407eed3d4 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:27.969217 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-aa266552-ee17-4ca3-a82a-7ca407eed3d4 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:27.969693 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-aa266552-ee17-4ca3-a82a-7ca407eed3d4 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:27.970736 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-aa266552-ee17-4ca3-a82a-7ca407eed3d4 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:27.970963 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-aa266552-ee17-4ca3-a82a-7ca407eed3d4 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:27.971347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-aa266552-ee17-4ca3-a82a-7ca407eed3d4 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:27.971818 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-aa266552-ee17-4ca3-a82a-7ca407eed3d4 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:28.126230 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-aa266552-ee17-4ca3-a82a-7ca407eed3d4 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:28.134762 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-aa266552-ee17-4ca3-a82a-7ca407eed3d4 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1752 microversion: 2.1 time: 0.177228 Aug 07 22:44:28.137109 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 393/770] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:27 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:28.439418 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-62f07460-4f05-4ee6-b07e-94e0d7db6fd9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:28.440099 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-62f07460-4f05-4ee6-b07e-94e0d7db6fd9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:28.446969 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-62f07460-4f05-4ee6-b07e-94e0d7db6fd9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:28.447595 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-62f07460-4f05-4ee6-b07e-94e0d7db6fd9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:28.448323 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-62f07460-4f05-4ee6-b07e-94e0d7db6fd9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:28.449198 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-62f07460-4f05-4ee6-b07e-94e0d7db6fd9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:28.449660 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-62f07460-4f05-4ee6-b07e-94e0d7db6fd9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:28.450085 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-62f07460-4f05-4ee6-b07e-94e0d7db6fd9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:28.514479 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-62f07460-4f05-4ee6-b07e-94e0d7db6fd9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:28.522215 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-62f07460-4f05-4ee6-b07e-94e0d7db6fd9 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c" status: 200 len: 1208 microversion: 2.1 time: 0.087127 Aug 07 22:44:28.523114 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 378/771] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:28 2022] GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c => generated 1208 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:29.156609 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-e6d4a66c-f688-47d0-b901-2afe1fd7ffbc tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:29.157889 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-e6d4a66c-f688-47d0-b901-2afe1fd7ffbc tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:29.165581 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e6d4a66c-f688-47d0-b901-2afe1fd7ffbc tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:29.166084 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e6d4a66c-f688-47d0-b901-2afe1fd7ffbc tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:29.166587 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e6d4a66c-f688-47d0-b901-2afe1fd7ffbc tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:29.167356 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e6d4a66c-f688-47d0-b901-2afe1fd7ffbc tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:29.167878 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e6d4a66c-f688-47d0-b901-2afe1fd7ffbc tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:29.168388 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e6d4a66c-f688-47d0-b901-2afe1fd7ffbc tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:29.316517 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-e6d4a66c-f688-47d0-b901-2afe1fd7ffbc tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:29.324783 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-e6d4a66c-f688-47d0-b901-2afe1fd7ffbc tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1757 microversion: 2.1 time: 0.172086 Aug 07 22:44:29.325359 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 394/772] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:29 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:29.543636 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-41f6f68b-7bbb-4d8f-b194-81ff624acb90 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:29.544312 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-41f6f68b-7bbb-4d8f-b194-81ff624acb90 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:29.547705 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:44:29.551164 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-41f6f68b-7bbb-4d8f-b194-81ff624acb90 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:29.551640 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-41f6f68b-7bbb-4d8f-b194-81ff624acb90 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:29.552099 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-41f6f68b-7bbb-4d8f-b194-81ff624acb90 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:29.552790 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-41f6f68b-7bbb-4d8f-b194-81ff624acb90 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:29.553240 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-41f6f68b-7bbb-4d8f-b194-81ff624acb90 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:29.553661 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-41f6f68b-7bbb-4d8f-b194-81ff624acb90 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:29.620366 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-41f6f68b-7bbb-4d8f-b194-81ff624acb90 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:29.627767 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-41f6f68b-7bbb-4d8f-b194-81ff624acb90 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c" status: 200 len: 1272 microversion: 2.1 time: 0.088682 Aug 07 22:44:29.628359 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 379/773] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:29 2022] GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c => generated 1272 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:30.346747 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-193816eb-5314-4cab-9a8e-88debf358ce5 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:30.347267 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-193816eb-5314-4cab-9a8e-88debf358ce5 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:30.353706 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-193816eb-5314-4cab-9a8e-88debf358ce5 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:30.354230 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-193816eb-5314-4cab-9a8e-88debf358ce5 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:30.354657 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-193816eb-5314-4cab-9a8e-88debf358ce5 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:30.355338 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-193816eb-5314-4cab-9a8e-88debf358ce5 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:30.355783 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-193816eb-5314-4cab-9a8e-88debf358ce5 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:30.356225 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-193816eb-5314-4cab-9a8e-88debf358ce5 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:30.504322 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-193816eb-5314-4cab-9a8e-88debf358ce5 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:30.513167 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-193816eb-5314-4cab-9a8e-88debf358ce5 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1757 microversion: 2.1 time: 0.170386 Aug 07 22:44:30.513739 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 395/774] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:30 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:30.650572 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-695b026e-6271-4437-9953-3838e4fa8a52 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:30.651256 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-695b026e-6271-4437-9953-3838e4fa8a52 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:30.658266 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-695b026e-6271-4437-9953-3838e4fa8a52 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:30.658751 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-695b026e-6271-4437-9953-3838e4fa8a52 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:30.659185 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-695b026e-6271-4437-9953-3838e4fa8a52 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:30.659879 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-695b026e-6271-4437-9953-3838e4fa8a52 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:30.660362 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-695b026e-6271-4437-9953-3838e4fa8a52 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:30.660787 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-695b026e-6271-4437-9953-3838e4fa8a52 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:30.794798 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-695b026e-6271-4437-9953-3838e4fa8a52 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:30.802295 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-695b026e-6271-4437-9953-3838e4fa8a52 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c" status: 200 len: 1312 microversion: 2.1 time: 0.156436 Aug 07 22:44:30.802855 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 380/775] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:30 2022] GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:31.130872 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-63c44bdd-9745-473f-b52e-4f3e6e8b83f1 req-a1e67f14-a5b4-4a3c-93d4-ed37c5309df9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c", "tag": "3ff6ef55-c706-4782-919d-1d1cc1935745"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:44:31.148234 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-63c44bdd-9745-473f-b52e-4f3e6e8b83f1 req-a1e67f14-a5b4-4a3c-93d4-ed37c5309df9 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:31.158161 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-63c44bdd-9745-473f-b52e-4f3e6e8b83f1 req-a1e67f14-a5b4-4a3c-93d4-ed37c5309df9 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:31.158161 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-63c44bdd-9745-473f-b52e-4f3e6e8b83f1 req-a1e67f14-a5b4-4a3c-93d4-ed37c5309df9 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:31.160253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-63c44bdd-9745-473f-b52e-4f3e6e8b83f1 req-a1e67f14-a5b4-4a3c-93d4-ed37c5309df9 service nova] Creating event network-changed:3ff6ef55-c706-4782-919d-1d1cc1935745 for instance 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c on hv-cinder-85032 Aug 07 22:44:31.165680 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-63c44bdd-9745-473f-b52e-4f3e6e8b83f1 req-a1e67f14-a5b4-4a3c-93d4-ed37c5309df9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038840 Aug 07 22:44:31.166272 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 396/776] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:44:31.534515 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-aa5cf7f4-eb4c-48e9-b6df-7d290d4efd24 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:31.535120 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-aa5cf7f4-eb4c-48e9-b6df-7d290d4efd24 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:31.541736 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-aa5cf7f4-eb4c-48e9-b6df-7d290d4efd24 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:31.542370 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-aa5cf7f4-eb4c-48e9-b6df-7d290d4efd24 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:31.542901 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-aa5cf7f4-eb4c-48e9-b6df-7d290d4efd24 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:31.543689 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-aa5cf7f4-eb4c-48e9-b6df-7d290d4efd24 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:31.544266 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-aa5cf7f4-eb4c-48e9-b6df-7d290d4efd24 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:31.544784 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-aa5cf7f4-eb4c-48e9-b6df-7d290d4efd24 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:31.775064 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-aa5cf7f4-eb4c-48e9-b6df-7d290d4efd24 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:31.784661 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-aa5cf7f4-eb4c-48e9-b6df-7d290d4efd24 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1757 microversion: 2.1 time: 0.253911 Aug 07 22:44:31.785228 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 381/777] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:31 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1757 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:31.830836 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-c825fa2c-388c-4a0f-9880-15e157b7c58f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:31.832219 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-c825fa2c-388c-4a0f-9880-15e157b7c58f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:31.838636 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c825fa2c-388c-4a0f-9880-15e157b7c58f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:31.839125 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c825fa2c-388c-4a0f-9880-15e157b7c58f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:31.839553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c825fa2c-388c-4a0f-9880-15e157b7c58f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:31.840480 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c825fa2c-388c-4a0f-9880-15e157b7c58f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:31.840934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c825fa2c-388c-4a0f-9880-15e157b7c58f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:31.841355 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c825fa2c-388c-4a0f-9880-15e157b7c58f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:32.029594 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-c825fa2c-388c-4a0f-9880-15e157b7c58f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:32.037259 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-c825fa2c-388c-4a0f-9880-15e157b7c58f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c" status: 200 len: 1312 microversion: 2.1 time: 0.211316 Aug 07 22:44:32.037972 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 397/778] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:31 2022] GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c => generated 1312 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:32.806341 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-193181bd-3dad-4911-97e2-2128e15c4b46 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:32.806955 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-193181bd-3dad-4911-97e2-2128e15c4b46 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:32.813376 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-193181bd-3dad-4911-97e2-2128e15c4b46 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:32.813860 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-193181bd-3dad-4911-97e2-2128e15c4b46 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:32.814301 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-193181bd-3dad-4911-97e2-2128e15c4b46 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:32.815024 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-193181bd-3dad-4911-97e2-2128e15c4b46 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:32.815483 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-193181bd-3dad-4911-97e2-2128e15c4b46 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:32.815922 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-193181bd-3dad-4911-97e2-2128e15c4b46 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:33.015715 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-193181bd-3dad-4911-97e2-2128e15c4b46 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:33.023933 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-193181bd-3dad-4911-97e2-2128e15c4b46 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1757 microversion: 2.1 time: 0.221549 Aug 07 22:44:33.024652 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 382/779] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:32 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1757 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:33.059048 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f4e50a4d-d716-4921-807f-734ebe6a077f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:33.059631 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f4e50a4d-d716-4921-807f-734ebe6a077f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:33.066193 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f4e50a4d-d716-4921-807f-734ebe6a077f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:33.070121 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f4e50a4d-d716-4921-807f-734ebe6a077f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:33.070121 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f4e50a4d-d716-4921-807f-734ebe6a077f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:33.070121 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f4e50a4d-d716-4921-807f-734ebe6a077f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:33.070121 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f4e50a4d-d716-4921-807f-734ebe6a077f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:33.071066 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f4e50a4d-d716-4921-807f-734ebe6a077f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:33.203470 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f4e50a4d-d716-4921-807f-734ebe6a077f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:33.211243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f4e50a4d-d716-4921-807f-734ebe6a077f tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c" status: 200 len: 1312 microversion: 2.1 time: 0.156653 Aug 07 22:44:33.211966 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 398/780] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:33 2022] GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:34.045985 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-a6b2ab8e-526c-4148-9759-4de6f3127615 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:34.046621 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-a6b2ab8e-526c-4148-9759-4de6f3127615 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:34.053241 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a6b2ab8e-526c-4148-9759-4de6f3127615 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:34.059702 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a6b2ab8e-526c-4148-9759-4de6f3127615 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:34.059702 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a6b2ab8e-526c-4148-9759-4de6f3127615 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:34.059702 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a6b2ab8e-526c-4148-9759-4de6f3127615 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:34.059702 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a6b2ab8e-526c-4148-9759-4de6f3127615 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:34.060094 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a6b2ab8e-526c-4148-9759-4de6f3127615 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:34.197862 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-a6b2ab8e-526c-4148-9759-4de6f3127615 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:34.206069 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-a6b2ab8e-526c-4148-9759-4de6f3127615 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1757 microversion: 2.1 time: 0.164138 Aug 07 22:44:34.206642 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 383/781] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:34 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:34.231588 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-c7224fcb-d3d8-4e30-950f-598f84aa4827 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:34.232247 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-c7224fcb-d3d8-4e30-950f-598f84aa4827 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:34.238536 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c7224fcb-d3d8-4e30-950f-598f84aa4827 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:34.239206 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c7224fcb-d3d8-4e30-950f-598f84aa4827 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:34.239631 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c7224fcb-d3d8-4e30-950f-598f84aa4827 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:34.240356 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c7224fcb-d3d8-4e30-950f-598f84aa4827 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:34.240803 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c7224fcb-d3d8-4e30-950f-598f84aa4827 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:34.241215 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c7224fcb-d3d8-4e30-950f-598f84aa4827 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:34.639993 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-c7224fcb-d3d8-4e30-950f-598f84aa4827 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:34.647439 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-c7224fcb-d3d8-4e30-950f-598f84aa4827 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c" status: 200 len: 1312 microversion: 2.1 time: 0.419692 Aug 07 22:44:34.648580 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 399/782] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:34 2022] GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c => generated 1312 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:35.226764 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-607675d7-7515-4397-930c-a6abbe2a3a80 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:35.227375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-607675d7-7515-4397-930c-a6abbe2a3a80 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:35.233838 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-607675d7-7515-4397-930c-a6abbe2a3a80 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:35.234323 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-607675d7-7515-4397-930c-a6abbe2a3a80 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:35.234757 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-607675d7-7515-4397-930c-a6abbe2a3a80 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:35.235447 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-607675d7-7515-4397-930c-a6abbe2a3a80 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:35.235900 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-607675d7-7515-4397-930c-a6abbe2a3a80 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:35.236370 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-607675d7-7515-4397-930c-a6abbe2a3a80 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:35.378616 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-607675d7-7515-4397-930c-a6abbe2a3a80 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:35.387708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-607675d7-7515-4397-930c-a6abbe2a3a80 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1757 microversion: 2.1 time: 0.164884 Aug 07 22:44:35.388265 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 384/783] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:35 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:35.669001 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a2335d03-d953-49d8-81b2-c299d1736df2 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:35.669539 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a2335d03-d953-49d8-81b2-c299d1736df2 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:35.675969 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a2335d03-d953-49d8-81b2-c299d1736df2 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:35.676474 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a2335d03-d953-49d8-81b2-c299d1736df2 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:35.676908 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a2335d03-d953-49d8-81b2-c299d1736df2 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:35.677589 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a2335d03-d953-49d8-81b2-c299d1736df2 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:35.678039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a2335d03-d953-49d8-81b2-c299d1736df2 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:35.678457 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a2335d03-d953-49d8-81b2-c299d1736df2 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:35.808645 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-a2335d03-d953-49d8-81b2-c299d1736df2 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:35.815852 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a2335d03-d953-49d8-81b2-c299d1736df2 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c" status: 200 len: 1312 microversion: 2.1 time: 0.150753 Aug 07 22:44:35.816439 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 400/784] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:35 2022] GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:36.408816 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-f9eeafa3-3c7a-4f20-9fad-5bb0d47ea699 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:36.409427 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-f9eeafa3-3c7a-4f20-9fad-5bb0d47ea699 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:36.416650 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f9eeafa3-3c7a-4f20-9fad-5bb0d47ea699 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:36.417133 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f9eeafa3-3c7a-4f20-9fad-5bb0d47ea699 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:36.417626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f9eeafa3-3c7a-4f20-9fad-5bb0d47ea699 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:36.418269 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f9eeafa3-3c7a-4f20-9fad-5bb0d47ea699 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:36.418724 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f9eeafa3-3c7a-4f20-9fad-5bb0d47ea699 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:36.419145 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f9eeafa3-3c7a-4f20-9fad-5bb0d47ea699 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:36.561116 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f9eeafa3-3c7a-4f20-9fad-5bb0d47ea699 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:36.569165 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-f9eeafa3-3c7a-4f20-9fad-5bb0d47ea699 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1757 microversion: 2.1 time: 0.164234 Aug 07 22:44:36.571683 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 385/785] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:36 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:36.638437 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-f8aea17f-88f6-4e7d-aacc-13730b28b2f6 req-7c590adb-38af-4126-894c-1f9d7c859035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c", "name": "network-vif-plugged", "status": "completed", "tag": "3ff6ef55-c706-4782-919d-1d1cc1935745"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:44:36.647797 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-f8aea17f-88f6-4e7d-aacc-13730b28b2f6 req-7c590adb-38af-4126-894c-1f9d7c859035 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:36.648379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-f8aea17f-88f6-4e7d-aacc-13730b28b2f6 req-7c590adb-38af-4126-894c-1f9d7c859035 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:36.648808 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-f8aea17f-88f6-4e7d-aacc-13730b28b2f6 req-7c590adb-38af-4126-894c-1f9d7c859035 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:36.659187 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-f8aea17f-88f6-4e7d-aacc-13730b28b2f6 req-7c590adb-38af-4126-894c-1f9d7c859035 service nova] Creating event network-vif-plugged:3ff6ef55-c706-4782-919d-1d1cc1935745 for instance 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c on hv-cinder-85032 Aug 07 22:44:36.664216 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-f8aea17f-88f6-4e7d-aacc-13730b28b2f6 req-7c590adb-38af-4126-894c-1f9d7c859035 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029554 Aug 07 22:44:36.664848 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 401/786] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:44:36.836209 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-8dba59ab-1b29-4419-b860-0c900e4c2bc0 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:36.836913 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-8dba59ab-1b29-4419-b860-0c900e4c2bc0 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:36.843001 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8dba59ab-1b29-4419-b860-0c900e4c2bc0 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:36.843484 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8dba59ab-1b29-4419-b860-0c900e4c2bc0 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:36.843920 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8dba59ab-1b29-4419-b860-0c900e4c2bc0 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:36.844703 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8dba59ab-1b29-4419-b860-0c900e4c2bc0 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:36.845161 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8dba59ab-1b29-4419-b860-0c900e4c2bc0 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:36.848469 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8dba59ab-1b29-4419-b860-0c900e4c2bc0 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:37.014066 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8dba59ab-1b29-4419-b860-0c900e4c2bc0 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:37.021929 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-8dba59ab-1b29-4419-b860-0c900e4c2bc0 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c" status: 200 len: 1312 microversion: 2.1 time: 0.190093 Aug 07 22:44:37.022514 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 386/787] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:36 2022] GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c => generated 1312 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:37.588568 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=2 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:44:37.592665 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-029b7b12-ab92-49c4-a059-6f476d1cad7b tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:37.593353 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-029b7b12-ab92-49c4-a059-6f476d1cad7b tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:37.599324 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-029b7b12-ab92-49c4-a059-6f476d1cad7b tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:37.602066 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-029b7b12-ab92-49c4-a059-6f476d1cad7b tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:37.602066 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-029b7b12-ab92-49c4-a059-6f476d1cad7b tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:37.602066 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-029b7b12-ab92-49c4-a059-6f476d1cad7b tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:37.602066 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-029b7b12-ab92-49c4-a059-6f476d1cad7b tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:37.602434 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-029b7b12-ab92-49c4-a059-6f476d1cad7b tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:37.605875 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:44:37.742951 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-029b7b12-ab92-49c4-a059-6f476d1cad7b tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:37.750750 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-029b7b12-ab92-49c4-a059-6f476d1cad7b tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1757 microversion: 2.1 time: 0.163615 Aug 07 22:44:37.751316 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 402/788] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:37 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:44:38.043070 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-2de605fc-c6b8-4fe0-a603-30e0bb92c72d tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:38.043682 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-2de605fc-c6b8-4fe0-a603-30e0bb92c72d tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:38.045553 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=2 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:44:38.046204 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=6 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:44:38.051491 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2de605fc-c6b8-4fe0-a603-30e0bb92c72d tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:38.051969 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2de605fc-c6b8-4fe0-a603-30e0bb92c72d tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:38.052458 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2de605fc-c6b8-4fe0-a603-30e0bb92c72d tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:38.053144 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2de605fc-c6b8-4fe0-a603-30e0bb92c72d tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:38.053601 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2de605fc-c6b8-4fe0-a603-30e0bb92c72d tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:38.054026 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2de605fc-c6b8-4fe0-a603-30e0bb92c72d tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:38.187938 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-2de605fc-c6b8-4fe0-a603-30e0bb92c72d tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:38.196186 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-2de605fc-c6b8-4fe0-a603-30e0bb92c72d tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c" status: 200 len: 1312 microversion: 2.1 time: 0.156896 Aug 07 22:44:38.196751 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 387/789] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:38 2022] GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:38.771841 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-95023f71-1176-4d4c-9a5a-8a74bcbe5411 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:38.772468 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-95023f71-1176-4d4c-9a5a-8a74bcbe5411 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:38.778946 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-95023f71-1176-4d4c-9a5a-8a74bcbe5411 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:38.779424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-95023f71-1176-4d4c-9a5a-8a74bcbe5411 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:38.779880 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-95023f71-1176-4d4c-9a5a-8a74bcbe5411 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:38.780582 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-95023f71-1176-4d4c-9a5a-8a74bcbe5411 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:38.781025 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-95023f71-1176-4d4c-9a5a-8a74bcbe5411 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:38.781436 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-95023f71-1176-4d4c-9a5a-8a74bcbe5411 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:38.925351 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-95023f71-1176-4d4c-9a5a-8a74bcbe5411 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:38.933629 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-95023f71-1176-4d4c-9a5a-8a74bcbe5411 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1757 microversion: 2.1 time: 0.165737 Aug 07 22:44:38.934225 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 403/790] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:38 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:39.216956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-c5915753-e2aa-4a69-a543-8476880b5021 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:39.217588 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-c5915753-e2aa-4a69-a543-8476880b5021 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:39.224048 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c5915753-e2aa-4a69-a543-8476880b5021 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:39.224528 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c5915753-e2aa-4a69-a543-8476880b5021 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:39.224960 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c5915753-e2aa-4a69-a543-8476880b5021 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:39.225648 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c5915753-e2aa-4a69-a543-8476880b5021 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:39.226344 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c5915753-e2aa-4a69-a543-8476880b5021 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:39.226774 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c5915753-e2aa-4a69-a543-8476880b5021 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:39.230779 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:44:39.362740 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-c5915753-e2aa-4a69-a543-8476880b5021 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:39.370286 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-c5915753-e2aa-4a69-a543-8476880b5021 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c" status: 200 len: 1496 microversion: 2.1 time: 0.157178 Aug 07 22:44:39.370863 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 388/791] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:39 2022] GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c => generated 1496 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:39.955009 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-56a542b9-9207-4915-ac19-8379d71977ac tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:39.955632 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-56a542b9-9207-4915-ac19-8379d71977ac tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:39.962428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-56a542b9-9207-4915-ac19-8379d71977ac tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:39.962903 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-56a542b9-9207-4915-ac19-8379d71977ac tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:39.963337 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-56a542b9-9207-4915-ac19-8379d71977ac tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:39.964128 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-56a542b9-9207-4915-ac19-8379d71977ac tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:39.964523 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-56a542b9-9207-4915-ac19-8379d71977ac tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:39.964940 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-56a542b9-9207-4915-ac19-8379d71977ac tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:40.107679 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-56a542b9-9207-4915-ac19-8379d71977ac tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:40.115681 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-56a542b9-9207-4915-ac19-8379d71977ac tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1757 microversion: 2.1 time: 0.164715 Aug 07 22:44:40.116270 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 404/792] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:39 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:40.212369 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-2b90cb6d-da25-405b-9679-456fb65cfc01 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:40.212951 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-2b90cb6d-da25-405b-9679-456fb65cfc01 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:40.218912 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2b90cb6d-da25-405b-9679-456fb65cfc01 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:40.219492 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2b90cb6d-da25-405b-9679-456fb65cfc01 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:40.219749 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2b90cb6d-da25-405b-9679-456fb65cfc01 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:40.220458 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2b90cb6d-da25-405b-9679-456fb65cfc01 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:40.220912 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2b90cb6d-da25-405b-9679-456fb65cfc01 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:40.221334 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2b90cb6d-da25-405b-9679-456fb65cfc01 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:40.247215 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-2b90cb6d-da25-405b-9679-456fb65cfc01 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c] Going to try to terminate instance {{(pid=129965) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 22:44:40.531338 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-2b90cb6d-da25-405b-9679-456fb65cfc01 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c" status: 204 len: 0 microversion: 2.1 time: 0.322696 Aug 07 22:44:40.533869 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 389/793] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:44:40 2022] DELETE /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 22:44:40.541018 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-441ef968-6b63-47cd-9292-2e296a8cf208 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:40.541625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-441ef968-6b63-47cd-9292-2e296a8cf208 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:40.543452 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:44:40.548133 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-441ef968-6b63-47cd-9292-2e296a8cf208 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:40.548608 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-441ef968-6b63-47cd-9292-2e296a8cf208 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:40.549039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-441ef968-6b63-47cd-9292-2e296a8cf208 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:40.549719 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-441ef968-6b63-47cd-9292-2e296a8cf208 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:40.550165 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-441ef968-6b63-47cd-9292-2e296a8cf208 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:40.550584 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-441ef968-6b63-47cd-9292-2e296a8cf208 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:40.679144 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-441ef968-6b63-47cd-9292-2e296a8cf208 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:40.687155 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-441ef968-6b63-47cd-9292-2e296a8cf208 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c" status: 200 len: 1502 microversion: 2.1 time: 0.150760 Aug 07 22:44:40.690349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 405/794] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:40 2022] GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:41.138754 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-87dbe85a-347a-4ba3-9610-404ff26b358b tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:41.139453 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-87dbe85a-347a-4ba3-9610-404ff26b358b tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:41.145356 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-87dbe85a-347a-4ba3-9610-404ff26b358b tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:41.145825 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-87dbe85a-347a-4ba3-9610-404ff26b358b tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:41.146252 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-87dbe85a-347a-4ba3-9610-404ff26b358b tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:41.146925 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-87dbe85a-347a-4ba3-9610-404ff26b358b tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:41.147368 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-87dbe85a-347a-4ba3-9610-404ff26b358b tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:41.147821 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-87dbe85a-347a-4ba3-9610-404ff26b358b tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:41.292636 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-87dbe85a-347a-4ba3-9610-404ff26b358b tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:41.300632 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-87dbe85a-347a-4ba3-9610-404ff26b358b tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1760 microversion: 2.1 time: 0.166333 Aug 07 22:44:41.301202 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 390/795] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:41 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1760 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:41.708853 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a9b0e448-ccaf-4c39-bdd0-da78469661fa tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:41.709497 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a9b0e448-ccaf-4c39-bdd0-da78469661fa tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:41.716276 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a9b0e448-ccaf-4c39-bdd0-da78469661fa tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:41.716756 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a9b0e448-ccaf-4c39-bdd0-da78469661fa tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:41.717194 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a9b0e448-ccaf-4c39-bdd0-da78469661fa tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:41.717887 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a9b0e448-ccaf-4c39-bdd0-da78469661fa tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:41.718341 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a9b0e448-ccaf-4c39-bdd0-da78469661fa tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:41.718774 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a9b0e448-ccaf-4c39-bdd0-da78469661fa tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:41.849298 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-a9b0e448-ccaf-4c39-bdd0-da78469661fa tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:41.857246 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a9b0e448-ccaf-4c39-bdd0-da78469661fa tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c" status: 200 len: 1502 microversion: 2.1 time: 0.152278 Aug 07 22:44:41.857801 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 406/796] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:41 2022] GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:42.671253 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-08fc67c5-9cb0-4fde-be5d-26c715fd32a5 req-0ed07e85-4654-4f52-8474-a8b7bd7f5ebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c", "name": "network-vif-deleted", "tag": "3ff6ef55-c706-4782-919d-1d1cc1935745"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:44:42.681639 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-08fc67c5-9cb0-4fde-be5d-26c715fd32a5 req-0ed07e85-4654-4f52-8474-a8b7bd7f5ebb service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:42.687157 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-08fc67c5-9cb0-4fde-be5d-26c715fd32a5 req-0ed07e85-4654-4f52-8474-a8b7bd7f5ebb service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:42.687157 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-08fc67c5-9cb0-4fde-be5d-26c715fd32a5 req-0ed07e85-4654-4f52-8474-a8b7bd7f5ebb service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:42.693251 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-08fc67c5-9cb0-4fde-be5d-26c715fd32a5 req-0ed07e85-4654-4f52-8474-a8b7bd7f5ebb service nova] Creating event network-vif-deleted:3ff6ef55-c706-4782-919d-1d1cc1935745 for instance 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c on hv-cinder-85032 Aug 07 22:44:42.698069 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-08fc67c5-9cb0-4fde-be5d-26c715fd32a5 req-0ed07e85-4654-4f52-8474-a8b7bd7f5ebb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030490 Aug 07 22:44:42.698677 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 391/797] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:44:42.878202 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-77fb0dbf-6c74-4326-87ab-12fb094acf0a tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:42.878748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-77fb0dbf-6c74-4326-87ab-12fb094acf0a tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:42.885244 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-77fb0dbf-6c74-4326-87ab-12fb094acf0a tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:42.885723 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-77fb0dbf-6c74-4326-87ab-12fb094acf0a tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:42.886159 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-77fb0dbf-6c74-4326-87ab-12fb094acf0a tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:42.887102 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-77fb0dbf-6c74-4326-87ab-12fb094acf0a tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:42.887550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-77fb0dbf-6c74-4326-87ab-12fb094acf0a tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:42.887970 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-77fb0dbf-6c74-4326-87ab-12fb094acf0a tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:42.951245 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-77fb0dbf-6c74-4326-87ab-12fb094acf0a tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269193a67b504842b3858022b378ae2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2648957a96504832a5693026f9d99c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:42.958870 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-77fb0dbf-6c74-4326-87ab-12fb094acf0a tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c" status: 200 len: 1297 microversion: 2.1 time: 0.084667 Aug 07 22:44:42.959455 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 407/798] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:42 2022] GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:43.981112 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7ed4ef95-4c60-4023-bf61-4154d0e40813 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:43.981837 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-7ed4ef95-4c60-4023-bf61-4154d0e40813 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] [instance: 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:43.988047 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7ed4ef95-4c60-4023-bf61-4154d0e40813 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:43.988526 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7ed4ef95-4c60-4023-bf61-4154d0e40813 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:43.988956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7ed4ef95-4c60-4023-bf61-4154d0e40813 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:43.989636 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7ed4ef95-4c60-4023-bf61-4154d0e40813 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:43.990083 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7ed4ef95-4c60-4023-bf61-4154d0e40813 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:43.990500 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7ed4ef95-4c60-4023-bf61-4154d0e40813 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:44.003338 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.wsgi [None req-7ed4ef95-4c60-4023-bf61-4154d0e40813 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] HTTP exception thrown: Instance 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c could not be found. Aug 07 22:44:44.009329 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7ed4ef95-4c60-4023-bf61-4154d0e40813 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Request method failure captured: Aug 07 22:44:44.009329 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: request: GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c HTTP/1.1 Aug 07 22:44:44.009329 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept: application/json Aug 07 22:44:44.009329 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept-Encoding: identity Aug 07 22:44:44.009329 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Connection: close Aug 07 22:44:44.009329 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Length: 0 Aug 07 22:44:44.009329 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Type: application/json Aug 07 22:44:44.009329 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Host: 10.222.0.30 Aug 07 22:44:44.009329 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Openstack-System-Scope: None Aug 07 22:44:44.009329 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: User-Agent: python-urllib3/1.26.11 Aug 07 22:44:44.009329 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Auth-Token: gAAAAABi8EAy9yDP4b-R9T-9T7UXWC61ly9Nez7NHfkehAH-Nxh9tEcQohm21v5rhjC_H_IxNZFTIo4UcnP5Kz0PHHk454gQGp5s1hGG2Je8aDxxvaBKA8QMburS6R_dfDyKacmw3kOj74Ru8AFLKiIt7CenyOfXUb9t5IUL-GrKL2S46pDjrpw Aug 07 22:44:44.009329 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Id: None Aug 07 22:44:44.009329 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Name: None Aug 07 22:44:44.009329 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Identity-Status: Confirmed Aug 07 22:44:44.009329 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Is-Admin-Project: True Aug 07 22:44:44.009329 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Id: default Aug 07 22:44:44.009329 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Name: Default Aug 07 22:44:44.009329 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Id: 2648957a96504832a5693026f9d99c58 Aug 07 22:44:44.009329 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Name: tempest-VolumesActionsTest-1542252996 Aug 07 22:44:44.009329 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Role: reader,member Aug 07 22:44:44.009329 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Roles: reader,member Aug 07 22:44:44.010938 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2648957a96504832a5693026f9d99c58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2648957a96504832a5693026f9d99c58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2648957a96504832a5693026f9d99c58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2648957a96504832a5693026f9d99c58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:44:44.010938 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant: tempest-VolumesActionsTest-1542252996 Aug 07 22:44:44.010938 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Id: 2648957a96504832a5693026f9d99c58 Aug 07 22:44:44.010938 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Name: tempest-VolumesActionsTest-1542252996 Aug 07 22:44:44.010938 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User: tempest-VolumesActionsTest-1542252996-project Aug 07 22:44:44.010938 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Id: default Aug 07 22:44:44.010938 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Name: Default Aug 07 22:44:44.010938 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Id: 269193a67b504842b3858022b378ae2a Aug 07 22:44:44.010938 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Name: tempest-VolumesActionsTest-1542252996-project Aug 07 22:44:44.010938 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: method: > Aug 07 22:44:44.010938 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: exception: Instance 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c could not be found. Aug 07 22:44:44.010938 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: action_args: {'id': '3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c'} Aug 07 22:44:44.012293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:44:44.012293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:44:44.012293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:44:44.012293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:44:44.012293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:44:44.012293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:44:44.012293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:44:44.012293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:44:44.012293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:44:44.012293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:44:44.012293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c could not be found. Aug 07 22:44:44.012293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:44:44.012293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:44:44.012293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:44:44.012293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:44:44.012293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:44:44.012293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:44:44.012293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:44:44.012293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:44:44.012293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:44:44.013942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:44:44.013942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:44:44.013942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:44:44.013942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:44:44.013942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:44:44.013942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:44:44.013942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:44:44.013942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c could not be found. Aug 07 22:44:44.013942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:44:44.013942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:44:44.013942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:44:44.013942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:44:44.013942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:44:44.013942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:44:44.013942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:44:44.013942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:44:44.013942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c could not be found. Aug 07 22:44:44.013942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:44:44.015292 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7ed4ef95-4c60-4023-bf61-4154d0e40813 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] Returning 404 to user: Instance 3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c could not be found. {{(pid=129965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:44:44.015292 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-7ed4ef95-4c60-4023-bf61-4154d0e40813 tempest-VolumesActionsTest-1542252996 tempest-VolumesActionsTest-1542252996-project] 10.222.0.30 "GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c" status: 404 len: 111 microversion: 2.1 time: 0.030096 Aug 07 22:44:44.015292 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 392/799] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:44:43 2022] GET /compute/v2.1/servers/3e6133a7-c33e-4766-9f8a-ac62bf8fbc0c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:44:48.496349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-da598a77-dc05-4983-a2cf-c48086959ce8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:48.498571 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-da598a77-dc05-4983-a2cf-c48086959ce8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:48.505044 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-da598a77-dc05-4983-a2cf-c48086959ce8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:48.505523 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-da598a77-dc05-4983-a2cf-c48086959ce8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:48.505956 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-da598a77-dc05-4983-a2cf-c48086959ce8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:48.506635 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-da598a77-dc05-4983-a2cf-c48086959ce8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:48.507082 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-da598a77-dc05-4983-a2cf-c48086959ce8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:48.507506 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-da598a77-dc05-4983-a2cf-c48086959ce8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:48.536400 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-da598a77-dc05-4983-a2cf-c48086959ce8 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043959 Aug 07 22:44:48.536948 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 408/800] 10.222.0.30 () {60 vars in 1343 bytes} [Sun Aug 7 22:44:48 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:44:48.599275 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-17e8222c-4c90-45c3-8e85-ee2d8aa8bde2 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:48.599765 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-17e8222c-4c90-45c3-8e85-ee2d8aa8bde2 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:48.606934 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-17e8222c-4c90-45c3-8e85-ee2d8aa8bde2 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:48.607411 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-17e8222c-4c90-45c3-8e85-ee2d8aa8bde2 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:48.607849 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-17e8222c-4c90-45c3-8e85-ee2d8aa8bde2 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:48.608572 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-17e8222c-4c90-45c3-8e85-ee2d8aa8bde2 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:48.609034 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-17e8222c-4c90-45c3-8e85-ee2d8aa8bde2 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:48.609460 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-17e8222c-4c90-45c3-8e85-ee2d8aa8bde2 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:48.633656 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-17e8222c-4c90-45c3-8e85-ee2d8aa8bde2 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Going to try to terminate instance {{(pid=129965) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 22:44:48.928858 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-17e8222c-4c90-45c3-8e85-ee2d8aa8bde2 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 204 len: 0 microversion: 2.20 time: 0.333045 Aug 07 22:44:48.929447 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 393/801] 10.222.0.30 () {60 vars in 1280 bytes} [Sun Aug 7 22:44:48 2022] DELETE /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 22:44:48.939821 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b445136f-27f4-4d11-90ca-6847480957ce tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:48.940785 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-b445136f-27f4-4d11-90ca-6847480957ce tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:48.947984 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b445136f-27f4-4d11-90ca-6847480957ce tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:48.948489 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b445136f-27f4-4d11-90ca-6847480957ce tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:48.948921 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b445136f-27f4-4d11-90ca-6847480957ce tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:48.949605 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b445136f-27f4-4d11-90ca-6847480957ce tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:48.950056 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b445136f-27f4-4d11-90ca-6847480957ce tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:48.950476 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b445136f-27f4-4d11-90ca-6847480957ce tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:49.084147 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-b445136f-27f4-4d11-90ca-6847480957ce tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:49.092328 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-b445136f-27f4-4d11-90ca-6847480957ce tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:49.093848 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-b445136f-27f4-4d11-90ca-6847480957ce tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:49.094955 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-b445136f-27f4-4d11-90ca-6847480957ce tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1724 microversion: 2.20 time: 0.160990 Aug 07 22:44:49.095510 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 409/802] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:44:48 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:44:50.120687 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-9d74d0a4-1607-449e-b1d8-839d2c85e501 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:50.121466 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-9d74d0a4-1607-449e-b1d8-839d2c85e501 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:50.132179 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9d74d0a4-1607-449e-b1d8-839d2c85e501 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:50.132922 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9d74d0a4-1607-449e-b1d8-839d2c85e501 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:50.133590 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9d74d0a4-1607-449e-b1d8-839d2c85e501 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:50.134605 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9d74d0a4-1607-449e-b1d8-839d2c85e501 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:50.135064 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9d74d0a4-1607-449e-b1d8-839d2c85e501 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:50.135486 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9d74d0a4-1607-449e-b1d8-839d2c85e501 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:50.288143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-9d74d0a4-1607-449e-b1d8-839d2c85e501 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:50.297755 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-9d74d0a4-1607-449e-b1d8-839d2c85e501 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:50.299958 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-9d74d0a4-1607-449e-b1d8-839d2c85e501 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:50.301173 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-9d74d0a4-1607-449e-b1d8-839d2c85e501 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1724 microversion: 2.20 time: 0.186014 Aug 07 22:44:50.317957 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 394/803] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:44:50 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:44:51.326188 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f00ea566-79ff-487a-b0d8-375e0d8d8498 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:51.327564 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f00ea566-79ff-487a-b0d8-375e0d8d8498 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:51.339075 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f00ea566-79ff-487a-b0d8-375e0d8d8498 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:51.340867 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f00ea566-79ff-487a-b0d8-375e0d8d8498 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:51.341942 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f00ea566-79ff-487a-b0d8-375e0d8d8498 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:51.343909 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f00ea566-79ff-487a-b0d8-375e0d8d8498 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:51.344386 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f00ea566-79ff-487a-b0d8-375e0d8d8498 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:51.345450 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f00ea566-79ff-487a-b0d8-375e0d8d8498 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:51.487095 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f00ea566-79ff-487a-b0d8-375e0d8d8498 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:51.501870 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f00ea566-79ff-487a-b0d8-375e0d8d8498 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:51.504788 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f00ea566-79ff-487a-b0d8-375e0d8d8498 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:51.506463 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f00ea566-79ff-487a-b0d8-375e0d8d8498 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1656 microversion: 2.20 time: 0.185188 Aug 07 22:44:51.507347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 410/804] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:44:51 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1656 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:44:51.627575 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-a77d723b-f47e-4c86-acc9-e4e3dda1599d req-19950350-3a8b-4fa1-8ebb-de26f96c95d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cef2464-0337-4fbd-a727-a24160f14f99", "name": "network-vif-deleted", "tag": "28f8e101-7a4a-4833-b344-83657618e970"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:44:51.643375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-a77d723b-f47e-4c86-acc9-e4e3dda1599d req-19950350-3a8b-4fa1-8ebb-de26f96c95d9 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:51.643948 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-a77d723b-f47e-4c86-acc9-e4e3dda1599d req-19950350-3a8b-4fa1-8ebb-de26f96c95d9 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:51.644474 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-a77d723b-f47e-4c86-acc9-e4e3dda1599d req-19950350-3a8b-4fa1-8ebb-de26f96c95d9 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:51.660605 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-a77d723b-f47e-4c86-acc9-e4e3dda1599d req-19950350-3a8b-4fa1-8ebb-de26f96c95d9 service nova] Creating event network-vif-deleted:28f8e101-7a4a-4833-b344-83657618e970 for instance 9cef2464-0337-4fbd-a727-a24160f14f99 on hv-cinder-85032 Aug 07 22:44:51.671333 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-a77d723b-f47e-4c86-acc9-e4e3dda1599d req-19950350-3a8b-4fa1-8ebb-de26f96c95d9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050847 Aug 07 22:44:51.672378 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 395/805] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:44:52.577495 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f8b20626-0786-4921-8318-b42d1151f9bb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:52.577495 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f8b20626-0786-4921-8318-b42d1151f9bb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:52.577495 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f8b20626-0786-4921-8318-b42d1151f9bb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:52.577495 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f8b20626-0786-4921-8318-b42d1151f9bb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:52.578631 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f8b20626-0786-4921-8318-b42d1151f9bb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:52.578631 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f8b20626-0786-4921-8318-b42d1151f9bb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:52.578631 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f8b20626-0786-4921-8318-b42d1151f9bb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:52.578631 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f8b20626-0786-4921-8318-b42d1151f9bb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:52.585313 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f8b20626-0786-4921-8318-b42d1151f9bb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:52.585715 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f8b20626-0786-4921-8318-b42d1151f9bb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:52.586719 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f8b20626-0786-4921-8318-b42d1151f9bb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:52.587167 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.objects.instance [None req-f8b20626-0786-4921-8318-b42d1151f9bb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lazy-loading 'fault' on Instance uuid 9cef2464-0337-4fbd-a727-a24160f14f99 {{(pid=129964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:44:52.630873 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f8b20626-0786-4921-8318-b42d1151f9bb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:52.639410 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f8b20626-0786-4921-8318-b42d1151f9bb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:52.640943 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f8b20626-0786-4921-8318-b42d1151f9bb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05ef5ec6afb84c4abc0cb4862f041dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2694e7641088d957060a1001d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:44:52.642283 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f8b20626-0786-4921-8318-b42d1151f9bb tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 200 len: 1372 microversion: 2.20 time: 0.112415 Aug 07 22:44:52.642841 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 411/806] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:44:52 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 1372 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 22:44:53.668985 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-bb61f3e6-9e8c-4ed3-87fd-13610eb02490 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:53.671210 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-bb61f3e6-9e8c-4ed3-87fd-13610eb02490 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:53.685081 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bb61f3e6-9e8c-4ed3-87fd-13610eb02490 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:53.686771 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bb61f3e6-9e8c-4ed3-87fd-13610eb02490 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:53.687818 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bb61f3e6-9e8c-4ed3-87fd-13610eb02490 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:53.688596 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bb61f3e6-9e8c-4ed3-87fd-13610eb02490 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:53.689063 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bb61f3e6-9e8c-4ed3-87fd-13610eb02490 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:53.689488 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bb61f3e6-9e8c-4ed3-87fd-13610eb02490 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:53.710199 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.wsgi [None req-bb61f3e6-9e8c-4ed3-87fd-13610eb02490 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] HTTP exception thrown: Instance 9cef2464-0337-4fbd-a727-a24160f14f99 could not be found. Aug 07 22:44:53.715208 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-bb61f3e6-9e8c-4ed3-87fd-13610eb02490 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Request method failure captured: Aug 07 22:44:53.715208 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: request: GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 HTTP/1.1 Aug 07 22:44:53.715208 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept: application/json Aug 07 22:44:53.715208 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept-Encoding: identity Aug 07 22:44:53.715208 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Connection: close Aug 07 22:44:53.715208 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Length: 0 Aug 07 22:44:53.715208 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Type: application/json Aug 07 22:44:53.715208 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Host: 10.222.0.30 Aug 07 22:44:53.715208 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Openstack-System-Scope: None Aug 07 22:44:53.715208 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: User-Agent: python-urllib3/1.26.11 Aug 07 22:44:53.715208 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Auth-Token: gAAAAABi8D6thRYUMBWh5dPVk1nH64PMoAYZVfdTWstvuCrsmwiLbLyTV7XfxMosWmVDoj_8KTpyS29dJclN0n4ZR2KnewZn1iK-1wcZpnjsUMSXJ2ZJNCKAG2-kEkLWefx5_Nzu7eMjXR8ksTBDjIS5UWmOAGNA7WBPIZMEFdpQwGVcFMv6OX0 Aug 07 22:44:53.715208 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Id: None Aug 07 22:44:53.715208 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Name: None Aug 07 22:44:53.715208 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Identity-Status: Confirmed Aug 07 22:44:53.715208 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Is-Admin-Project: True Aug 07 22:44:53.715208 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 22:44:53.715208 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Id: default Aug 07 22:44:53.715208 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Name: Default Aug 07 22:44:53.715208 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Id: 3f7ea2694e7641088d957060a1001d86 Aug 07 22:44:53.715208 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-503792829 Aug 07 22:44:53.715208 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Role: reader,member Aug 07 22:44:53.715208 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Roles: reader,member Aug 07 22:44:53.716954 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f7ea2694e7641088d957060a1001d86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f7ea2694e7641088d957060a1001d86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f7ea2694e7641088d957060a1001d86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f7ea2694e7641088d957060a1001d86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:44:53.716954 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant: tempest-AttachVolumeShelveTestJSON-503792829 Aug 07 22:44:53.716954 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Id: 3f7ea2694e7641088d957060a1001d86 Aug 07 22:44:53.716954 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-503792829 Aug 07 22:44:53.716954 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User: tempest-AttachVolumeShelveTestJSON-503792829-project Aug 07 22:44:53.716954 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Id: default Aug 07 22:44:53.716954 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Name: Default Aug 07 22:44:53.716954 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Id: 05ef5ec6afb84c4abc0cb4862f041dd1 Aug 07 22:44:53.716954 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Name: tempest-AttachVolumeShelveTestJSON-503792829-project Aug 07 22:44:53.716954 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: method: > Aug 07 22:44:53.716954 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: exception: Instance 9cef2464-0337-4fbd-a727-a24160f14f99 could not be found. Aug 07 22:44:53.716954 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: action_args: {'id': '9cef2464-0337-4fbd-a727-a24160f14f99'} Aug 07 22:44:53.717899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:44:53.717899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:44:53.717899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:44:53.717899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:44:53.717899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:44:53.717899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:44:53.717899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:44:53.717899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:44:53.717899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:44:53.717899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:44:53.717899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cef2464-0337-4fbd-a727-a24160f14f99 could not be found. Aug 07 22:44:53.717899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:44:53.717899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:44:53.717899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:44:53.717899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:44:53.717899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:44:53.717899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:44:53.717899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:44:53.717899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:44:53.717899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:44:53.719405 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:44:53.719405 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:44:53.719405 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:44:53.719405 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:44:53.719405 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:44:53.719405 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:44:53.719405 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:44:53.719405 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cef2464-0337-4fbd-a727-a24160f14f99 could not be found. Aug 07 22:44:53.719405 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:44:53.719405 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:44:53.719405 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:44:53.719405 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:44:53.719405 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:44:53.719405 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:44:53.719405 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:44:53.719405 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:44:53.719405 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cef2464-0337-4fbd-a727-a24160f14f99 could not be found. Aug 07 22:44:53.719405 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:44:53.720805 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-bb61f3e6-9e8c-4ed3-87fd-13610eb02490 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Returning 404 to user: Instance 9cef2464-0337-4fbd-a727-a24160f14f99 could not be found. {{(pid=129965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:44:53.720805 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-bb61f3e6-9e8c-4ed3-87fd-13610eb02490 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 404 len: 111 microversion: 2.20 time: 0.055333 Aug 07 22:44:53.725569 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 396/807] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:44:53 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 22:44:53.729354 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f05d994d-8f24-410b-86ce-1851cc05928f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '.version_select at 0x7fc09fafe820>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:53.817996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f05d994d-8f24-410b-86ce-1851cc05928f tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1974831983" status: 204 len: 0 microversion: 2.20 time: 0.092766 Aug 07 22:44:53.819217 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 412/808] 10.222.0.30 () {60 vars in 1262 bytes} [Sun Aug 7 22:44:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1974831983 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 07 22:44:56.119934 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ed17d0a9-50d8-40cc-a6aa-2158097dc94d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:56.120463 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-ed17d0a9-50d8-40cc-a6aa-2158097dc94d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:56.129017 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ed17d0a9-50d8-40cc-a6aa-2158097dc94d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:56.129762 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ed17d0a9-50d8-40cc-a6aa-2158097dc94d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:56.130383 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ed17d0a9-50d8-40cc-a6aa-2158097dc94d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:56.131084 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ed17d0a9-50d8-40cc-a6aa-2158097dc94d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:56.131536 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ed17d0a9-50d8-40cc-a6aa-2158097dc94d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:56.132266 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ed17d0a9-50d8-40cc-a6aa-2158097dc94d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:56.146655 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.wsgi [None req-ed17d0a9-50d8-40cc-a6aa-2158097dc94d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] HTTP exception thrown: Instance 9cef2464-0337-4fbd-a727-a24160f14f99 could not be found. Aug 07 22:44:56.148243 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ed17d0a9-50d8-40cc-a6aa-2158097dc94d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Request method failure captured: Aug 07 22:44:56.148243 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: request: DELETE /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 HTTP/1.1 Aug 07 22:44:56.148243 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept: application/json Aug 07 22:44:56.148243 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept-Encoding: identity Aug 07 22:44:56.148243 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Connection: close Aug 07 22:44:56.148243 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Length: 0 Aug 07 22:44:56.148243 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Type: application/json Aug 07 22:44:56.148243 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Host: 10.222.0.30 Aug 07 22:44:56.148243 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Openstack-System-Scope: None Aug 07 22:44:56.148243 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: User-Agent: python-urllib3/1.26.11 Aug 07 22:44:56.148243 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Auth-Token: gAAAAABi8D6thRYUMBWh5dPVk1nH64PMoAYZVfdTWstvuCrsmwiLbLyTV7XfxMosWmVDoj_8KTpyS29dJclN0n4ZR2KnewZn1iK-1wcZpnjsUMSXJ2ZJNCKAG2-kEkLWefx5_Nzu7eMjXR8ksTBDjIS5UWmOAGNA7WBPIZMEFdpQwGVcFMv6OX0 Aug 07 22:44:56.148243 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Id: None Aug 07 22:44:56.148243 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Name: None Aug 07 22:44:56.148243 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Identity-Status: Confirmed Aug 07 22:44:56.148243 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Is-Admin-Project: True Aug 07 22:44:56.148243 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 22:44:56.148243 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Id: default Aug 07 22:44:56.148243 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Name: Default Aug 07 22:44:56.148243 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Id: 3f7ea2694e7641088d957060a1001d86 Aug 07 22:44:56.148243 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-503792829 Aug 07 22:44:56.148243 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Role: reader,member Aug 07 22:44:56.148243 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Roles: reader,member Aug 07 22:44:56.150430 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f7ea2694e7641088d957060a1001d86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f7ea2694e7641088d957060a1001d86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f7ea2694e7641088d957060a1001d86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f7ea2694e7641088d957060a1001d86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:44:56.150430 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant: tempest-AttachVolumeShelveTestJSON-503792829 Aug 07 22:44:56.150430 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Id: 3f7ea2694e7641088d957060a1001d86 Aug 07 22:44:56.150430 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-503792829 Aug 07 22:44:56.150430 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User: tempest-AttachVolumeShelveTestJSON-503792829-project Aug 07 22:44:56.150430 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Id: default Aug 07 22:44:56.150430 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Name: Default Aug 07 22:44:56.150430 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Id: 05ef5ec6afb84c4abc0cb4862f041dd1 Aug 07 22:44:56.150430 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Name: tempest-AttachVolumeShelveTestJSON-503792829-project Aug 07 22:44:56.150430 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: method: > Aug 07 22:44:56.150430 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: exception: Instance 9cef2464-0337-4fbd-a727-a24160f14f99 could not be found. Aug 07 22:44:56.150430 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: action_args: {'id': '9cef2464-0337-4fbd-a727-a24160f14f99'} Aug 07 22:44:56.151310 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:44:56.151310 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:44:56.151310 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:44:56.151310 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:44:56.151310 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:44:56.151310 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:44:56.151310 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:44:56.151310 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:44:56.151310 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:44:56.151310 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:44:56.151310 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cef2464-0337-4fbd-a727-a24160f14f99 could not be found. Aug 07 22:44:56.151310 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:44:56.151310 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:44:56.151310 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:44:56.151310 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:44:56.151310 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:44:56.151310 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:44:56.151310 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:44:56.151310 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:44:56.151310 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:44:56.152781 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:44:56.152781 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 22:44:56.152781 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 22:44:56.152781 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 22:44:56.152781 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 22:44:56.152781 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:44:56.152781 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:44:56.152781 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:44:56.152781 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:44:56.152781 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cef2464-0337-4fbd-a727-a24160f14f99 could not be found. Aug 07 22:44:56.152781 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:44:56.152781 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:44:56.152781 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:44:56.152781 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:44:56.152781 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:44:56.152781 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:44:56.152781 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:44:56.152781 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:44:56.152781 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cef2464-0337-4fbd-a727-a24160f14f99 could not be found. Aug 07 22:44:56.152781 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:44:56.154850 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ed17d0a9-50d8-40cc-a6aa-2158097dc94d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Returning 404 to user: Instance 9cef2464-0337-4fbd-a727-a24160f14f99 could not be found. {{(pid=129965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:44:56.155688 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-ed17d0a9-50d8-40cc-a6aa-2158097dc94d tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 404 len: 111 microversion: 2.20 time: 0.040498 Aug 07 22:44:56.156579 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 397/809] 10.222.0.30 () {60 vars in 1280 bytes} [Sun Aug 7 22:44:56 2022] DELETE /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 22:44:56.164640 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-326160d4-70aa-4677-8833-452e9f724686 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:56.165915 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-326160d4-70aa-4677-8833-452e9f724686 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 9cef2464-0337-4fbd-a727-a24160f14f99] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:56.174448 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-326160d4-70aa-4677-8833-452e9f724686 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:56.175059 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-326160d4-70aa-4677-8833-452e9f724686 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:56.175593 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-326160d4-70aa-4677-8833-452e9f724686 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:56.176451 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-326160d4-70aa-4677-8833-452e9f724686 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:56.177000 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-326160d4-70aa-4677-8833-452e9f724686 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:56.177532 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-326160d4-70aa-4677-8833-452e9f724686 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:56.191543 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-326160d4-70aa-4677-8833-452e9f724686 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] HTTP exception thrown: Instance 9cef2464-0337-4fbd-a727-a24160f14f99 could not be found. Aug 07 22:44:56.193549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-326160d4-70aa-4677-8833-452e9f724686 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Request method failure captured: Aug 07 22:44:56.193549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 HTTP/1.1 Aug 07 22:44:56.193549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:44:56.193549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:44:56.193549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:44:56.193549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:44:56.193549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:44:56.193549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:44:56.193549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:44:56.193549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:44:56.193549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8D6thRYUMBWh5dPVk1nH64PMoAYZVfdTWstvuCrsmwiLbLyTV7XfxMosWmVDoj_8KTpyS29dJclN0n4ZR2KnewZn1iK-1wcZpnjsUMSXJ2ZJNCKAG2-kEkLWefx5_Nzu7eMjXR8ksTBDjIS5UWmOAGNA7WBPIZMEFdpQwGVcFMv6OX0 Aug 07 22:44:56.193549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:44:56.193549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:44:56.193549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:44:56.193549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:44:56.193549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 22:44:56.193549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:44:56.193549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:44:56.193549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 3f7ea2694e7641088d957060a1001d86 Aug 07 22:44:56.193549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-503792829 Aug 07 22:44:56.193549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:44:56.193549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:44:56.195310 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f7ea2694e7641088d957060a1001d86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f7ea2694e7641088d957060a1001d86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f7ea2694e7641088d957060a1001d86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f7ea2694e7641088d957060a1001d86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:44:56.195310 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-AttachVolumeShelveTestJSON-503792829 Aug 07 22:44:56.195310 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 3f7ea2694e7641088d957060a1001d86 Aug 07 22:44:56.195310 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-503792829 Aug 07 22:44:56.195310 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-AttachVolumeShelveTestJSON-503792829-project Aug 07 22:44:56.195310 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:44:56.195310 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:44:56.195310 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: 05ef5ec6afb84c4abc0cb4862f041dd1 Aug 07 22:44:56.195310 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-AttachVolumeShelveTestJSON-503792829-project Aug 07 22:44:56.195310 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: > Aug 07 22:44:56.195310 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Instance 9cef2464-0337-4fbd-a727-a24160f14f99 could not be found. Aug 07 22:44:56.195310 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': '9cef2464-0337-4fbd-a727-a24160f14f99'} Aug 07 22:44:56.196430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:44:56.196430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:44:56.196430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:44:56.196430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:44:56.196430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:44:56.196430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:44:56.196430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:44:56.196430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:44:56.196430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:44:56.196430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:44:56.196430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cef2464-0337-4fbd-a727-a24160f14f99 could not be found. Aug 07 22:44:56.196430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:44:56.196430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:44:56.196430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:44:56.196430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:44:56.196430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:44:56.196430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:44:56.196430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:44:56.196430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:44:56.196430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:44:56.197948 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:44:56.197948 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:44:56.197948 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:44:56.197948 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:44:56.197948 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:44:56.197948 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:44:56.197948 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:44:56.197948 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cef2464-0337-4fbd-a727-a24160f14f99 could not be found. Aug 07 22:44:56.197948 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:44:56.197948 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:44:56.197948 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:44:56.197948 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:44:56.197948 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:44:56.197948 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:44:56.197948 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:44:56.197948 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:44:56.197948 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cef2464-0337-4fbd-a727-a24160f14f99 could not be found. Aug 07 22:44:56.197948 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:44:56.199276 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-326160d4-70aa-4677-8833-452e9f724686 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Returning 404 to user: Instance 9cef2464-0337-4fbd-a727-a24160f14f99 could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:44:56.199795 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-326160d4-70aa-4677-8833-452e9f724686 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99" status: 404 len: 111 microversion: 2.20 time: 0.039115 Aug 07 22:44:56.201403 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 413/810] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:44:56 2022] GET /compute/v2.1/servers/9cef2464-0337-4fbd-a727-a24160f14f99 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 07 22:44:57.518058 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-6c0e21d2-4eab-4d29-9d81-1c9271dbd5a7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:57.518606 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-6c0e21d2-4eab-4d29-9d81-1c9271dbd5a7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:57.525668 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6c0e21d2-4eab-4d29-9d81-1c9271dbd5a7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:57.526363 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6c0e21d2-4eab-4d29-9d81-1c9271dbd5a7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:57.527077 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6c0e21d2-4eab-4d29-9d81-1c9271dbd5a7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:57.527942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6c0e21d2-4eab-4d29-9d81-1c9271dbd5a7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:57.528572 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6c0e21d2-4eab-4d29-9d81-1c9271dbd5a7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:57.529152 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6c0e21d2-4eab-4d29-9d81-1c9271dbd5a7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:57.543449 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.wsgi [None req-6c0e21d2-4eab-4d29-9d81-1c9271dbd5a7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] HTTP exception thrown: Instance 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba could not be found. Aug 07 22:44:57.545283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-6c0e21d2-4eab-4d29-9d81-1c9271dbd5a7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Request method failure captured: Aug 07 22:44:57.545283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: request: DELETE /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba HTTP/1.1 Aug 07 22:44:57.545283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept: application/json Aug 07 22:44:57.545283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept-Encoding: identity Aug 07 22:44:57.545283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Connection: close Aug 07 22:44:57.545283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Length: 0 Aug 07 22:44:57.545283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Type: application/json Aug 07 22:44:57.545283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Host: 10.222.0.30 Aug 07 22:44:57.545283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Openstack-System-Scope: None Aug 07 22:44:57.545283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: User-Agent: python-urllib3/1.26.11 Aug 07 22:44:57.545283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Auth-Token: gAAAAABi8D6thRYUMBWh5dPVk1nH64PMoAYZVfdTWstvuCrsmwiLbLyTV7XfxMosWmVDoj_8KTpyS29dJclN0n4ZR2KnewZn1iK-1wcZpnjsUMSXJ2ZJNCKAG2-kEkLWefx5_Nzu7eMjXR8ksTBDjIS5UWmOAGNA7WBPIZMEFdpQwGVcFMv6OX0 Aug 07 22:44:57.545283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Id: None Aug 07 22:44:57.545283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Name: None Aug 07 22:44:57.545283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Identity-Status: Confirmed Aug 07 22:44:57.545283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Is-Admin-Project: True Aug 07 22:44:57.545283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 22:44:57.545283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Id: default Aug 07 22:44:57.545283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Name: Default Aug 07 22:44:57.545283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Id: 3f7ea2694e7641088d957060a1001d86 Aug 07 22:44:57.545283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-503792829 Aug 07 22:44:57.545283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Role: reader,member Aug 07 22:44:57.545283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Roles: reader,member Aug 07 22:44:57.546971 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f7ea2694e7641088d957060a1001d86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f7ea2694e7641088d957060a1001d86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f7ea2694e7641088d957060a1001d86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f7ea2694e7641088d957060a1001d86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:44:57.546971 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant: tempest-AttachVolumeShelveTestJSON-503792829 Aug 07 22:44:57.546971 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Id: 3f7ea2694e7641088d957060a1001d86 Aug 07 22:44:57.546971 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-503792829 Aug 07 22:44:57.546971 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User: tempest-AttachVolumeShelveTestJSON-503792829-project Aug 07 22:44:57.546971 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Id: default Aug 07 22:44:57.546971 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Name: Default Aug 07 22:44:57.546971 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Id: 05ef5ec6afb84c4abc0cb4862f041dd1 Aug 07 22:44:57.546971 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Name: tempest-AttachVolumeShelveTestJSON-503792829-project Aug 07 22:44:57.546971 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: method: > Aug 07 22:44:57.546971 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: exception: Instance 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba could not be found. Aug 07 22:44:57.546971 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: action_args: {'id': '8bda9470-bb0f-45e2-9f1b-e4d1db51aeba'} Aug 07 22:44:57.547759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:44:57.547759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:44:57.547759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:44:57.547759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:44:57.547759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:44:57.547759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:44:57.547759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:44:57.547759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:44:57.547759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:44:57.547759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:44:57.547759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba could not be found. Aug 07 22:44:57.547759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:44:57.547759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:44:57.547759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:44:57.547759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:44:57.547759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:44:57.547759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:44:57.547759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:44:57.547759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:44:57.547759 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:44:57.549002 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:44:57.549002 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 22:44:57.549002 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 22:44:57.549002 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 22:44:57.549002 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 22:44:57.549002 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:44:57.549002 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:44:57.549002 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:44:57.549002 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:44:57.549002 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba could not be found. Aug 07 22:44:57.549002 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:44:57.549002 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:44:57.549002 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:44:57.549002 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:44:57.549002 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:44:57.549002 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:44:57.549002 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:44:57.549002 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:44:57.549002 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba could not be found. Aug 07 22:44:57.549002 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:44:57.551509 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-6c0e21d2-4eab-4d29-9d81-1c9271dbd5a7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Returning 404 to user: Instance 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba could not be found. {{(pid=129965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:44:57.552445 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-6c0e21d2-4eab-4d29-9d81-1c9271dbd5a7 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 404 len: 111 microversion: 2.20 time: 0.038739 Aug 07 22:44:57.556689 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 398/811] 10.222.0.30 () {60 vars in 1280 bytes} [Sun Aug 7 22:44:57 2022] DELETE /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 22:44:57.561940 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a971c972-5569-4b3b-baad-12184e2a1be4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:44:57.562570 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a971c972-5569-4b3b-baad-12184e2a1be4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] [instance: 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:44:57.568790 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a971c972-5569-4b3b-baad-12184e2a1be4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:57.569521 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a971c972-5569-4b3b-baad-12184e2a1be4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:57.569960 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a971c972-5569-4b3b-baad-12184e2a1be4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:57.571468 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a971c972-5569-4b3b-baad-12184e2a1be4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:44:57.571963 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a971c972-5569-4b3b-baad-12184e2a1be4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:44:57.572405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a971c972-5569-4b3b-baad-12184e2a1be4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:44:57.587625 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-a971c972-5569-4b3b-baad-12184e2a1be4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] HTTP exception thrown: Instance 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba could not be found. Aug 07 22:44:57.589173 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a971c972-5569-4b3b-baad-12184e2a1be4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Request method failure captured: Aug 07 22:44:57.589173 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba HTTP/1.1 Aug 07 22:44:57.589173 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:44:57.589173 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:44:57.589173 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:44:57.589173 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:44:57.589173 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:44:57.589173 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:44:57.589173 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:44:57.589173 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:44:57.589173 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8D6thRYUMBWh5dPVk1nH64PMoAYZVfdTWstvuCrsmwiLbLyTV7XfxMosWmVDoj_8KTpyS29dJclN0n4ZR2KnewZn1iK-1wcZpnjsUMSXJ2ZJNCKAG2-kEkLWefx5_Nzu7eMjXR8ksTBDjIS5UWmOAGNA7WBPIZMEFdpQwGVcFMv6OX0 Aug 07 22:44:57.589173 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:44:57.589173 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:44:57.589173 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:44:57.589173 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:44:57.589173 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 22:44:57.589173 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:44:57.589173 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:44:57.589173 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 3f7ea2694e7641088d957060a1001d86 Aug 07 22:44:57.589173 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-503792829 Aug 07 22:44:57.589173 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:44:57.589173 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:44:57.590649 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f7ea2694e7641088d957060a1001d86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f7ea2694e7641088d957060a1001d86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f7ea2694e7641088d957060a1001d86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f7ea2694e7641088d957060a1001d86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:44:57.590649 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-AttachVolumeShelveTestJSON-503792829 Aug 07 22:44:57.590649 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 3f7ea2694e7641088d957060a1001d86 Aug 07 22:44:57.590649 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-503792829 Aug 07 22:44:57.590649 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-AttachVolumeShelveTestJSON-503792829-project Aug 07 22:44:57.590649 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:44:57.590649 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:44:57.590649 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: 05ef5ec6afb84c4abc0cb4862f041dd1 Aug 07 22:44:57.590649 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-AttachVolumeShelveTestJSON-503792829-project Aug 07 22:44:57.590649 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: > Aug 07 22:44:57.590649 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Instance 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba could not be found. Aug 07 22:44:57.590649 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': '8bda9470-bb0f-45e2-9f1b-e4d1db51aeba'} Aug 07 22:44:57.591489 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:44:57.591489 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:44:57.591489 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:44:57.591489 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:44:57.591489 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:44:57.591489 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:44:57.591489 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:44:57.591489 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:44:57.591489 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:44:57.591489 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:44:57.591489 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba could not be found. Aug 07 22:44:57.591489 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:44:57.591489 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:44:57.591489 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:44:57.591489 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:44:57.591489 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:44:57.591489 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:44:57.591489 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:44:57.591489 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:44:57.591489 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:44:57.593351 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:44:57.593351 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:44:57.593351 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:44:57.593351 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:44:57.593351 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:44:57.593351 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:44:57.593351 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:44:57.593351 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba could not be found. Aug 07 22:44:57.593351 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:44:57.593351 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:44:57.593351 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:44:57.593351 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:44:57.593351 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:44:57.593351 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:44:57.593351 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:44:57.593351 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:44:57.593351 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba could not be found. Aug 07 22:44:57.593351 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:44:57.595905 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a971c972-5569-4b3b-baad-12184e2a1be4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] Returning 404 to user: Instance 8bda9470-bb0f-45e2-9f1b-e4d1db51aeba could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:44:57.595905 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a971c972-5569-4b3b-baad-12184e2a1be4 tempest-AttachVolumeShelveTestJSON-503792829 tempest-AttachVolumeShelveTestJSON-503792829-project] 10.222.0.30 "GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba" status: 404 len: 111 microversion: 2.20 time: 0.037284 Aug 07 22:44:57.595905 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 414/812] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 22:44:57 2022] GET /compute/v2.1/servers/8bda9470-bb0f-45e2-9f1b-e4d1db51aeba => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 22:45:09.810517 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:45:09.811261 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:45:09.934993 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-c183a780-2127-42f6-b326-7bd3a46998dd tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Action: 'create', calling method: .version_select at 0x7fc0ac40bdc0>, body: {"keypair": {"name": "tempest-keypair-12344583", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmHRX//y9z/7MfBIK4+4ra8kWdfU1mrMgMODT3W4ThARkmTRBWAr/XwgHjWWXPp9wXZUUU52cgpy+nFSpbWqip/P2auwmYNI8pPmxOOpVERRayyU/g8GbsqNICuCMdaMw=="}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:45:09.951493 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-c183a780-2127-42f6-b326-7bd3a46998dd tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Getting quotas for project dd66028a147f42e1aa29abd7c22d00f9. Resources: {'key_pairs'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:45:09.955392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-c183a780-2127-42f6-b326-7bd3a46998dd tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Getting quotas for user 990056333138468c99292c3f00605e6c and project dd66028a147f42e1aa29abd7c22d00f9. Resources: {'key_pairs'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:45:10.046367 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-c183a780-2127-42f6-b326-7bd3a46998dd tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.241903 Aug 07 22:45:10.047112 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 399/813] 10.222.0.30 () {60 vars in 1159 bytes} [Sun Aug 7 22:45:09 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:45:12.665874 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-ec30de4f-d2d6-4401-b5fe-bb7c92186ca6 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-179053727", "imageRef": "91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d4e4604-9d4f-40f0-a6e7-b7d1c70da8ee"}], "security_groups": [{"name": "tempest-securitygroup--746583684"}], "key_name": "tempest-keypair-12344583", "user_data": "}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:45:12.675401 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:45:12.676106 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=64 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:45:12.780253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.network.neutron [None req-ec30de4f-d2d6-4401-b5fe-bb7c92186ca6 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] validate_networks() for [('8d4e4604-9d4f-40f0-a6e7-b7d1c70da8ee', None, None, None, None, None)] {{(pid=129964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 22:45:13.197240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-ec30de4f-d2d6-4401-b5fe-bb7c92186ca6 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Flavor limits 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 22:45:13.203698 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-ec30de4f-d2d6-4401-b5fe-bb7c92186ca6 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Image limits 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 22:45:13.203698 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-ec30de4f-d2d6-4401-b5fe-bb7c92186ca6 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Flavor pref 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 22:45:13.203698 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-ec30de4f-d2d6-4401-b5fe-bb7c92186ca6 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Image pref 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 22:45:13.203698 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-ec30de4f-d2d6-4401-b5fe-bb7c92186ca6 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 22:45:13.208357 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ec30de4f-d2d6-4401-b5fe-bb7c92186ca6 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:13.209068 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ec30de4f-d2d6-4401-b5fe-bb7c92186ca6 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:13.209496 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ec30de4f-d2d6-4401-b5fe-bb7c92186ca6 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:13.210237 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ec30de4f-d2d6-4401-b5fe-bb7c92186ca6 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:13.212649 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ec30de4f-d2d6-4401-b5fe-bb7c92186ca6 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:13.213546 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ec30de4f-d2d6-4401-b5fe-bb7c92186ca6 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:13.233852 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-ec30de4f-d2d6-4401-b5fe-bb7c92186ca6 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Getting quotas for project dd66028a147f42e1aa29abd7c22d00f9. Resources: {'cores', 'instances', 'ram'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:45:13.238398 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-ec30de4f-d2d6-4401-b5fe-bb7c92186ca6 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Getting quotas for user 990056333138468c99292c3f00605e6c and project dd66028a147f42e1aa29abd7c22d00f9. Resources: {'cores', 'instances', 'ram'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:45:13.251747 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-ec30de4f-d2d6-4401-b5fe-bb7c92186ca6 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Going to run 1 instances... {{(pid=129964) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 22:45:13.254077 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-ec30de4f-d2d6-4401-b5fe-bb7c92186ca6 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 22:45:13.469290 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-ec30de4f-d2d6-4401-b5fe-bb7c92186ca6 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.807819 Aug 07 22:45:13.471398 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 415/814] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 22:45:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 22:45:13.484138 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-3484063a-967b-4d31-9d43-d2489565595b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:13.485371 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-3484063a-967b-4d31-9d43-d2489565595b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:13.548828 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-3484063a-967b-4d31-9d43-d2489565595b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:13.557209 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-3484063a-967b-4d31-9d43-d2489565595b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1235 microversion: 2.1 time: 0.077893 Aug 07 22:45:13.558096 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 400/815] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:13 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1235 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:14.578506 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a0759f3c-0c23-440d-a239-74c4f697422c tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:14.579121 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a0759f3c-0c23-440d-a239-74c4f697422c tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:14.633250 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-a0759f3c-0c23-440d-a239-74c4f697422c tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:14.641315 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a0759f3c-0c23-440d-a239-74c4f697422c tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1235 microversion: 2.1 time: 0.067290 Aug 07 22:45:14.644871 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 416/816] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:14 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1235 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:15.669897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-f3dc72d7-2595-48f5-bbc1-47f97cbe7ea3 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:15.669897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-f3dc72d7-2595-48f5-bbc1-47f97cbe7ea3 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:15.675180 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f3dc72d7-2595-48f5-bbc1-47f97cbe7ea3 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:15.675655 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f3dc72d7-2595-48f5-bbc1-47f97cbe7ea3 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:15.676156 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f3dc72d7-2595-48f5-bbc1-47f97cbe7ea3 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:15.676929 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f3dc72d7-2595-48f5-bbc1-47f97cbe7ea3 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:15.677378 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f3dc72d7-2595-48f5-bbc1-47f97cbe7ea3 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:15.677798 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f3dc72d7-2595-48f5-bbc1-47f97cbe7ea3 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:15.754647 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f3dc72d7-2595-48f5-bbc1-47f97cbe7ea3 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:15.769448 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-f3dc72d7-2595-48f5-bbc1-47f97cbe7ea3 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1287 microversion: 2.1 time: 0.108863 Aug 07 22:45:15.770032 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 401/817] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:15 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:16.792432 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-6ff3cc82-5a70-45b0-85a8-89838b1a98a9 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:16.793158 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-6ff3cc82-5a70-45b0-85a8-89838b1a98a9 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:16.799673 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6ff3cc82-5a70-45b0-85a8-89838b1a98a9 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:16.800259 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6ff3cc82-5a70-45b0-85a8-89838b1a98a9 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:16.800761 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6ff3cc82-5a70-45b0-85a8-89838b1a98a9 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:16.801539 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6ff3cc82-5a70-45b0-85a8-89838b1a98a9 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:16.802056 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6ff3cc82-5a70-45b0-85a8-89838b1a98a9 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:16.802546 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6ff3cc82-5a70-45b0-85a8-89838b1a98a9 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:17.076267 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-6ff3cc82-5a70-45b0-85a8-89838b1a98a9 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:17.084432 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-6ff3cc82-5a70-45b0-85a8-89838b1a98a9 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1360 microversion: 2.1 time: 0.296322 Aug 07 22:45:17.085028 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 417/818] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:16 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1360 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:17.598294 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-8dc9dbc6-6d3e-4ad0-8c6b-634a12feb5ab req-31bfb43c-ddb3-474c-891d-d2dbd9f597c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3243af5d-9b7f-4839-9877-cf6edb147c8b", "tag": "d4da0a83-078e-472f-880d-48ba7a21c476"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:45:17.610897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-8dc9dbc6-6d3e-4ad0-8c6b-634a12feb5ab req-31bfb43c-ddb3-474c-891d-d2dbd9f597c0 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:17.611387 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-8dc9dbc6-6d3e-4ad0-8c6b-634a12feb5ab req-31bfb43c-ddb3-474c-891d-d2dbd9f597c0 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:17.611820 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-8dc9dbc6-6d3e-4ad0-8c6b-634a12feb5ab req-31bfb43c-ddb3-474c-891d-d2dbd9f597c0 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:17.624306 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-8dc9dbc6-6d3e-4ad0-8c6b-634a12feb5ab req-31bfb43c-ddb3-474c-891d-d2dbd9f597c0 service nova] Creating event network-changed:d4da0a83-078e-472f-880d-48ba7a21c476 for instance 3243af5d-9b7f-4839-9877-cf6edb147c8b on hv-cinder-85032 Aug 07 22:45:17.629611 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-8dc9dbc6-6d3e-4ad0-8c6b-634a12feb5ab req-31bfb43c-ddb3-474c-891d-d2dbd9f597c0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035158 Aug 07 22:45:17.630430 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 402/819] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:45:18.107433 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-775e95fa-4e36-40af-91d5-4b4d11f27fa1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:18.108264 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-775e95fa-4e36-40af-91d5-4b4d11f27fa1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:18.115321 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-775e95fa-4e36-40af-91d5-4b4d11f27fa1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:18.115880 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-775e95fa-4e36-40af-91d5-4b4d11f27fa1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:18.116393 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-775e95fa-4e36-40af-91d5-4b4d11f27fa1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:18.117501 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-775e95fa-4e36-40af-91d5-4b4d11f27fa1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:18.118019 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-775e95fa-4e36-40af-91d5-4b4d11f27fa1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:18.118504 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-775e95fa-4e36-40af-91d5-4b4d11f27fa1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:18.364986 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-775e95fa-4e36-40af-91d5-4b4d11f27fa1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:18.372582 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-775e95fa-4e36-40af-91d5-4b4d11f27fa1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1360 microversion: 2.1 time: 0.269715 Aug 07 22:45:18.373142 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 418/820] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:18 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1360 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:19.153732 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-902a20c5-1beb-4b1c-8d99-1873c02bec8d tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1247212807", "imageRef": "91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8", "flavorRef": "452"}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:45:19.207553 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.network.neutron [None req-902a20c5-1beb-4b1c-8d99-1873c02bec8d tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] validate_networks() for None {{(pid=129965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 22:45:19.393984 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f212adae-6e04-4316-a37e-d175621cf1cd tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:19.394595 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f212adae-6e04-4316-a37e-d175621cf1cd tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:19.401543 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f212adae-6e04-4316-a37e-d175621cf1cd tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:19.402033 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f212adae-6e04-4316-a37e-d175621cf1cd tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:19.402467 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f212adae-6e04-4316-a37e-d175621cf1cd tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:19.403155 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f212adae-6e04-4316-a37e-d175621cf1cd tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:19.403607 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f212adae-6e04-4316-a37e-d175621cf1cd tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:19.404051 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f212adae-6e04-4316-a37e-d175621cf1cd tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:19.510995 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-902a20c5-1beb-4b1c-8d99-1873c02bec8d tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Flavor limits 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 22:45:19.511442 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-902a20c5-1beb-4b1c-8d99-1873c02bec8d tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Image limits 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 22:45:19.512227 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-902a20c5-1beb-4b1c-8d99-1873c02bec8d tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Flavor pref 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 22:45:19.512631 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-902a20c5-1beb-4b1c-8d99-1873c02bec8d tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Image pref 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 22:45:19.513041 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-902a20c5-1beb-4b1c-8d99-1873c02bec8d tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 22:45:19.522082 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-902a20c5-1beb-4b1c-8d99-1873c02bec8d tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:19.522562 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-902a20c5-1beb-4b1c-8d99-1873c02bec8d tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:19.523004 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-902a20c5-1beb-4b1c-8d99-1873c02bec8d tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:19.523868 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-902a20c5-1beb-4b1c-8d99-1873c02bec8d tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:19.524354 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-902a20c5-1beb-4b1c-8d99-1873c02bec8d tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:19.524784 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-902a20c5-1beb-4b1c-8d99-1873c02bec8d tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:19.541535 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-902a20c5-1beb-4b1c-8d99-1873c02bec8d tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Getting quotas for project ad0a4d9a434e41cab6cdc7e20fd8b0bb. Resources: {'cores', 'instances', 'ram'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:45:19.545532 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-902a20c5-1beb-4b1c-8d99-1873c02bec8d tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Getting quotas for user 097f69347f5a460ea7650d9854260e97 and project ad0a4d9a434e41cab6cdc7e20fd8b0bb. Resources: {'cores', 'instances', 'ram'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:45:19.557362 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-902a20c5-1beb-4b1c-8d99-1873c02bec8d tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Going to run 1 instances... {{(pid=129965) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 22:45:19.559713 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-902a20c5-1beb-4b1c-8d99-1873c02bec8d tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] [instance: 99d7a54f-8639-45d1-a003-6b122c0218af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 22:45:19.568637 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f212adae-6e04-4316-a37e-d175621cf1cd tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:19.576684 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f212adae-6e04-4316-a37e-d175621cf1cd tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1360 microversion: 2.1 time: 0.186601 Aug 07 22:45:19.577240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 419/821] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:19 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1360 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:45:19.691403 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-902a20c5-1beb-4b1c-8d99-1873c02bec8d tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541991 Aug 07 22:45:19.692072 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 403/822] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 22:45:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 22:45:19.703073 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-177d52e4-99bc-4006-aed9-00c15f51da73 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:19.703683 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-177d52e4-99bc-4006-aed9-00c15f51da73 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] [instance: 99d7a54f-8639-45d1-a003-6b122c0218af] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:19.758723 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-177d52e4-99bc-4006-aed9-00c15f51da73 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097f69347f5a460ea7650d9854260e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0a4d9a434e41cab6cdc7e20fd8b0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:19.765589 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-177d52e4-99bc-4006-aed9-00c15f51da73 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] 10.222.0.30 "GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af" status: 200 len: 1215 microversion: 2.1 time: 0.066386 Aug 07 22:45:19.766151 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 420/823] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:19 2022] GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:20.597196 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-9b06f128-8055-4240-8e50-4b825223f248 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:20.597730 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-9b06f128-8055-4240-8e50-4b825223f248 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:20.605121 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9b06f128-8055-4240-8e50-4b825223f248 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:20.605959 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9b06f128-8055-4240-8e50-4b825223f248 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:20.606062 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9b06f128-8055-4240-8e50-4b825223f248 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:20.606752 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9b06f128-8055-4240-8e50-4b825223f248 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:20.607206 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9b06f128-8055-4240-8e50-4b825223f248 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:20.607628 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9b06f128-8055-4240-8e50-4b825223f248 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:20.745950 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-9b06f128-8055-4240-8e50-4b825223f248 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:20.754177 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-9b06f128-8055-4240-8e50-4b825223f248 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1360 microversion: 2.1 time: 0.161313 Aug 07 22:45:20.754841 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 404/824] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:20 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1360 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:20.786216 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-2ac02d36-61a7-456a-ae1f-f453888ab006 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:20.786830 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-2ac02d36-61a7-456a-ae1f-f453888ab006 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] [instance: 99d7a54f-8639-45d1-a003-6b122c0218af] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:20.794565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2ac02d36-61a7-456a-ae1f-f453888ab006 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:20.795120 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2ac02d36-61a7-456a-ae1f-f453888ab006 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:20.795563 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2ac02d36-61a7-456a-ae1f-f453888ab006 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:20.796289 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2ac02d36-61a7-456a-ae1f-f453888ab006 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:20.796740 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2ac02d36-61a7-456a-ae1f-f453888ab006 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:20.797159 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2ac02d36-61a7-456a-ae1f-f453888ab006 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:20.857197 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-2ac02d36-61a7-456a-ae1f-f453888ab006 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097f69347f5a460ea7650d9854260e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0a4d9a434e41cab6cdc7e20fd8b0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:20.864626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-2ac02d36-61a7-456a-ae1f-f453888ab006 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] 10.222.0.30 "GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af" status: 200 len: 1219 microversion: 2.1 time: 0.082478 Aug 07 22:45:20.865190 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 421/825] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:20 2022] GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:21.777751 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-1042c5a3-cc32-4e40-89af-d5089dc186aa tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:21.778596 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-1042c5a3-cc32-4e40-89af-d5089dc186aa tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:21.785459 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1042c5a3-cc32-4e40-89af-d5089dc186aa tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:21.785635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1042c5a3-cc32-4e40-89af-d5089dc186aa tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:21.786063 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1042c5a3-cc32-4e40-89af-d5089dc186aa tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:21.786820 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1042c5a3-cc32-4e40-89af-d5089dc186aa tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:21.787339 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1042c5a3-cc32-4e40-89af-d5089dc186aa tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:21.787851 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1042c5a3-cc32-4e40-89af-d5089dc186aa tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:21.886139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-955dc8a5-7a38-4f23-a5d2-e13cbc73ec2f tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:21.887129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-955dc8a5-7a38-4f23-a5d2-e13cbc73ec2f tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] [instance: 99d7a54f-8639-45d1-a003-6b122c0218af] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:21.896967 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-955dc8a5-7a38-4f23-a5d2-e13cbc73ec2f tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:21.897568 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-955dc8a5-7a38-4f23-a5d2-e13cbc73ec2f tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:21.898182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-955dc8a5-7a38-4f23-a5d2-e13cbc73ec2f tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:21.899669 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-955dc8a5-7a38-4f23-a5d2-e13cbc73ec2f tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:21.900320 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-955dc8a5-7a38-4f23-a5d2-e13cbc73ec2f tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:21.900823 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-955dc8a5-7a38-4f23-a5d2-e13cbc73ec2f tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:21.987761 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-955dc8a5-7a38-4f23-a5d2-e13cbc73ec2f tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097f69347f5a460ea7650d9854260e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0a4d9a434e41cab6cdc7e20fd8b0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:21.996630 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-955dc8a5-7a38-4f23-a5d2-e13cbc73ec2f tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] 10.222.0.30 "GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af" status: 200 len: 1285 microversion: 2.1 time: 0.114975 Aug 07 22:45:21.997303 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 422/826] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:21 2022] GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af => generated 1285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:45:22.042317 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-1042c5a3-cc32-4e40-89af-d5089dc186aa tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:22.050142 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-1042c5a3-cc32-4e40-89af-d5089dc186aa tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1360 microversion: 2.1 time: 0.276733 Aug 07 22:45:22.050719 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 405/827] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:21 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1360 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:22.875590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-98557cfc-b945-4da0-9893-c6123a90584e req-41a886c5-8426-463b-9155-d14c280a11a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3243af5d-9b7f-4839-9877-cf6edb147c8b", "name": "network-vif-plugged", "status": "completed", "tag": "d4da0a83-078e-472f-880d-48ba7a21c476"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:45:22.887403 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-98557cfc-b945-4da0-9893-c6123a90584e req-41a886c5-8426-463b-9155-d14c280a11a0 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:22.887403 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-98557cfc-b945-4da0-9893-c6123a90584e req-41a886c5-8426-463b-9155-d14c280a11a0 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:22.887403 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-98557cfc-b945-4da0-9893-c6123a90584e req-41a886c5-8426-463b-9155-d14c280a11a0 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:22.899743 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-98557cfc-b945-4da0-9893-c6123a90584e req-41a886c5-8426-463b-9155-d14c280a11a0 service nova] Creating event network-vif-plugged:d4da0a83-078e-472f-880d-48ba7a21c476 for instance 3243af5d-9b7f-4839-9877-cf6edb147c8b on hv-cinder-85032 Aug 07 22:45:22.905090 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-98557cfc-b945-4da0-9893-c6123a90584e req-41a886c5-8426-463b-9155-d14c280a11a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033064 Aug 07 22:45:22.905685 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 423/828] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:45:23.018992 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d258436a-0ff3-4e38-8dd6-1238218ec92e tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:23.019774 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-d258436a-0ff3-4e38-8dd6-1238218ec92e tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] [instance: 99d7a54f-8639-45d1-a003-6b122c0218af] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:23.027171 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d258436a-0ff3-4e38-8dd6-1238218ec92e tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:23.028687 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d258436a-0ff3-4e38-8dd6-1238218ec92e tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:23.029335 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d258436a-0ff3-4e38-8dd6-1238218ec92e tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:23.030445 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d258436a-0ff3-4e38-8dd6-1238218ec92e tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:23.031157 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d258436a-0ff3-4e38-8dd6-1238218ec92e tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:23.031659 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d258436a-0ff3-4e38-8dd6-1238218ec92e tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:23.073696 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-51d95e79-a18b-46b7-a034-e94f8d104d93 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:23.075446 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-51d95e79-a18b-46b7-a034-e94f8d104d93 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:23.082727 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-51d95e79-a18b-46b7-a034-e94f8d104d93 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:23.083213 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-51d95e79-a18b-46b7-a034-e94f8d104d93 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:23.083836 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-51d95e79-a18b-46b7-a034-e94f8d104d93 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:23.084572 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-51d95e79-a18b-46b7-a034-e94f8d104d93 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:23.085024 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-51d95e79-a18b-46b7-a034-e94f8d104d93 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:23.085444 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-51d95e79-a18b-46b7-a034-e94f8d104d93 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:23.224958 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=2 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:45:23.330495 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-d258436a-0ff3-4e38-8dd6-1238218ec92e tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097f69347f5a460ea7650d9854260e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0a4d9a434e41cab6cdc7e20fd8b0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:23.337951 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-d258436a-0ff3-4e38-8dd6-1238218ec92e tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] 10.222.0.30 "GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af" status: 200 len: 1315 microversion: 2.1 time: 0.323193 Aug 07 22:45:23.338522 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 406/829] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:23 2022] GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:23.358847 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-51d95e79-a18b-46b7-a034-e94f8d104d93 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:23.366071 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-51d95e79-a18b-46b7-a034-e94f8d104d93 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1360 microversion: 2.1 time: 0.298023 Aug 07 22:45:23.366634 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 424/830] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:23 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1360 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:45:23.745608 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-a9fc8437-d830-45a0-8d3d-0ce08d8d37d4 req-8d13a784-dc04-4d09-ac75-1ca42087e982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d7a54f-8639-45d1-a003-6b122c0218af", "tag": "878bacfc-d8d6-45e3-91bc-b10fc42251c5"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:45:23.754844 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-a9fc8437-d830-45a0-8d3d-0ce08d8d37d4 req-8d13a784-dc04-4d09-ac75-1ca42087e982 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:23.755312 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-a9fc8437-d830-45a0-8d3d-0ce08d8d37d4 req-8d13a784-dc04-4d09-ac75-1ca42087e982 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:23.755742 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-a9fc8437-d830-45a0-8d3d-0ce08d8d37d4 req-8d13a784-dc04-4d09-ac75-1ca42087e982 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:23.767749 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-a9fc8437-d830-45a0-8d3d-0ce08d8d37d4 req-8d13a784-dc04-4d09-ac75-1ca42087e982 service nova] Creating event network-changed:878bacfc-d8d6-45e3-91bc-b10fc42251c5 for instance 99d7a54f-8639-45d1-a003-6b122c0218af on hv-cinder-85032 Aug 07 22:45:23.772711 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-a9fc8437-d830-45a0-8d3d-0ce08d8d37d4 req-8d13a784-dc04-4d09-ac75-1ca42087e982 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031933 Aug 07 22:45:23.773310 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 407/831] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:45:24.359396 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-29737a54-25fb-473c-9970-bb8e8b35ff2e tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:24.360005 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-29737a54-25fb-473c-9970-bb8e8b35ff2e tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] [instance: 99d7a54f-8639-45d1-a003-6b122c0218af] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:24.366470 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-29737a54-25fb-473c-9970-bb8e8b35ff2e tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:24.366941 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-29737a54-25fb-473c-9970-bb8e8b35ff2e tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:24.367371 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-29737a54-25fb-473c-9970-bb8e8b35ff2e tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:24.368654 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-29737a54-25fb-473c-9970-bb8e8b35ff2e tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:24.369111 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-29737a54-25fb-473c-9970-bb8e8b35ff2e tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:24.369532 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-29737a54-25fb-473c-9970-bb8e8b35ff2e tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:24.388538 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-5ab4c41a-33c1-4161-87ba-7f73bbb8d010 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:24.388538 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-5ab4c41a-33c1-4161-87ba-7f73bbb8d010 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:24.395084 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5ab4c41a-33c1-4161-87ba-7f73bbb8d010 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:24.395504 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5ab4c41a-33c1-4161-87ba-7f73bbb8d010 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:24.395949 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5ab4c41a-33c1-4161-87ba-7f73bbb8d010 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:24.396675 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5ab4c41a-33c1-4161-87ba-7f73bbb8d010 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:24.397134 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5ab4c41a-33c1-4161-87ba-7f73bbb8d010 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:24.397569 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5ab4c41a-33c1-4161-87ba-7f73bbb8d010 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:24.818289 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-29737a54-25fb-473c-9970-bb8e8b35ff2e tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097f69347f5a460ea7650d9854260e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0a4d9a434e41cab6cdc7e20fd8b0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:24.826832 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-29737a54-25fb-473c-9970-bb8e8b35ff2e tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] 10.222.0.30 "GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af" status: 200 len: 1315 microversion: 2.1 time: 0.471417 Aug 07 22:45:24.827402 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 425/832] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:24 2022] GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af => generated 1315 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:24.833538 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-5ab4c41a-33c1-4161-87ba-7f73bbb8d010 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:24.841634 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-5ab4c41a-33c1-4161-87ba-7f73bbb8d010 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1360 microversion: 2.1 time: 0.458693 Aug 07 22:45:24.842299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 408/833] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:24 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1360 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:45:24.853143 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-056286d1-5fe3-40b1-8abd-a9e99f17e79f tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1460737256"}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:45:24.853690 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-056286d1-5fe3-40b1-8abd-a9e99f17e79f tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:24.859815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-056286d1-5fe3-40b1-8abd-a9e99f17e79f tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:24.860410 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-056286d1-5fe3-40b1-8abd-a9e99f17e79f tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:24.860916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-056286d1-5fe3-40b1-8abd-a9e99f17e79f tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:24.861707 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-056286d1-5fe3-40b1-8abd-a9e99f17e79f tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:24.862232 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-056286d1-5fe3-40b1-8abd-a9e99f17e79f tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:24.862723 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-056286d1-5fe3-40b1-8abd-a9e99f17e79f tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:25.102562 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.network.security_group_api [None req-056286d1-5fe3-40b1-8abd-a9e99f17e79f tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Removing security group a645b010-16ef-446e-8d5a-b6ead42b3e84 from port 332a7e9e-deb8-4c55-afbc-6a7faca02b5e Aug 07 22:45:25.565221 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-056286d1-5fe3-40b1-8abd-a9e99f17e79f tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "POST /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d/action" status: 202 len: 0 microversion: 2.1 time: 0.736768 Aug 07 22:45:25.568738 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 426/834] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 22:45:24 2022] POST /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d/action => generated 0 bytes in 738 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:45:25.793571 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-3480a8ac-f04e-4706-b113-7b274e4945ed req-41f500cd-aa0f-4fa3-9270-1dc76efaa0e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de8d1496-5f71-442d-b1b0-712a7b4f598d", "tag": "332a7e9e-deb8-4c55-afbc-6a7faca02b5e"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:45:25.813192 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-3480a8ac-f04e-4706-b113-7b274e4945ed req-41f500cd-aa0f-4fa3-9270-1dc76efaa0e7 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:25.813810 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-3480a8ac-f04e-4706-b113-7b274e4945ed req-41f500cd-aa0f-4fa3-9270-1dc76efaa0e7 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:25.814239 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-3480a8ac-f04e-4706-b113-7b274e4945ed req-41f500cd-aa0f-4fa3-9270-1dc76efaa0e7 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:25.826368 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-3480a8ac-f04e-4706-b113-7b274e4945ed req-41f500cd-aa0f-4fa3-9270-1dc76efaa0e7 service nova] Creating event network-changed:332a7e9e-deb8-4c55-afbc-6a7faca02b5e for instance de8d1496-5f71-442d-b1b0-712a7b4f598d on hv-cinder-85032 Aug 07 22:45:25.831965 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-3480a8ac-f04e-4706-b113-7b274e4945ed req-41f500cd-aa0f-4fa3-9270-1dc76efaa0e7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042839 Aug 07 22:45:25.833098 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 409/835] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:45:25.848723 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-d761e433-7cbb-4589-9777-cc8a76ca40ee tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:25.849337 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-d761e433-7cbb-4589-9777-cc8a76ca40ee tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] [instance: 99d7a54f-8639-45d1-a003-6b122c0218af] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:25.857283 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d761e433-7cbb-4589-9777-cc8a76ca40ee tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:25.857283 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d761e433-7cbb-4589-9777-cc8a76ca40ee tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:25.857283 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d761e433-7cbb-4589-9777-cc8a76ca40ee tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:25.863550 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-22593636-392a-4f78-83ac-6c6721882489 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:25.864290 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-22593636-392a-4f78-83ac-6c6721882489 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:25.865878 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d761e433-7cbb-4589-9777-cc8a76ca40ee tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:25.866323 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d761e433-7cbb-4589-9777-cc8a76ca40ee tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:25.866748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d761e433-7cbb-4589-9777-cc8a76ca40ee tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:25.877319 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-22593636-392a-4f78-83ac-6c6721882489 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:25.878067 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-22593636-392a-4f78-83ac-6c6721882489 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:25.878508 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-22593636-392a-4f78-83ac-6c6721882489 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:25.879209 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-22593636-392a-4f78-83ac-6c6721882489 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:25.879655 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-22593636-392a-4f78-83ac-6c6721882489 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:25.880097 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-22593636-392a-4f78-83ac-6c6721882489 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:26.161235 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-d761e433-7cbb-4589-9777-cc8a76ca40ee tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097f69347f5a460ea7650d9854260e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0a4d9a434e41cab6cdc7e20fd8b0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:26.168679 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-d761e433-7cbb-4589-9777-cc8a76ca40ee tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] 10.222.0.30 "GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af" status: 200 len: 1315 microversion: 2.1 time: 0.324482 Aug 07 22:45:26.169246 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 427/836] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:25 2022] GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:26.170034 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-22593636-392a-4f78-83ac-6c6721882489 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:26.177468 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-22593636-392a-4f78-83ac-6c6721882489 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1545 microversion: 2.1 time: 0.318769 Aug 07 22:45:26.178027 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 410/837] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:25 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1545 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:26.202862 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-9077afc0-14c4-4fe4-8920-06c142a2f791 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:26.203362 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-9077afc0-14c4-4fe4-8920-06c142a2f791 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:26.209209 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9077afc0-14c4-4fe4-8920-06c142a2f791 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:26.209692 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9077afc0-14c4-4fe4-8920-06c142a2f791 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:26.210130 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9077afc0-14c4-4fe4-8920-06c142a2f791 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:26.210821 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9077afc0-14c4-4fe4-8920-06c142a2f791 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:26.211338 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9077afc0-14c4-4fe4-8920-06c142a2f791 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:26.212049 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9077afc0-14c4-4fe4-8920-06c142a2f791 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:26.370324 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-9077afc0-14c4-4fe4-8920-06c142a2f791 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.171274 Aug 07 22:45:26.370914 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 428/838] 10.222.0.30 () {58 vars in 1275 bytes} [Sun Aug 7 22:45:26 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b/os-interface => generated 284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:45:27.199727 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-cc685090-eff1-4ebe-822e-9bdb6018b1ab tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:27.200315 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-cc685090-eff1-4ebe-822e-9bdb6018b1ab tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] [instance: 99d7a54f-8639-45d1-a003-6b122c0218af] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:27.209413 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cc685090-eff1-4ebe-822e-9bdb6018b1ab tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:27.212171 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cc685090-eff1-4ebe-822e-9bdb6018b1ab tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:27.212608 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cc685090-eff1-4ebe-822e-9bdb6018b1ab tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:27.217640 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cc685090-eff1-4ebe-822e-9bdb6018b1ab tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:27.218124 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cc685090-eff1-4ebe-822e-9bdb6018b1ab tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:27.218565 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cc685090-eff1-4ebe-822e-9bdb6018b1ab tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:27.361091 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-bdbbc0b3-c7a5-40a7-b2cc-119f4f21d8c2 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:27.362216 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-bdbbc0b3-c7a5-40a7-b2cc-119f4f21d8c2 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:27.371251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdbbc0b3-c7a5-40a7-b2cc-119f4f21d8c2 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:27.371737 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdbbc0b3-c7a5-40a7-b2cc-119f4f21d8c2 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:27.374287 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdbbc0b3-c7a5-40a7-b2cc-119f4f21d8c2 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:27.380379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdbbc0b3-c7a5-40a7-b2cc-119f4f21d8c2 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:27.380379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdbbc0b3-c7a5-40a7-b2cc-119f4f21d8c2 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:27.380379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdbbc0b3-c7a5-40a7-b2cc-119f4f21d8c2 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:27.460757 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-cc685090-eff1-4ebe-822e-9bdb6018b1ab tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097f69347f5a460ea7650d9854260e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0a4d9a434e41cab6cdc7e20fd8b0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:27.479572 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-cc685090-eff1-4ebe-822e-9bdb6018b1ab tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] 10.222.0.30 "GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af" status: 200 len: 1315 microversion: 2.1 time: 0.283657 Aug 07 22:45:27.509893 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 411/839] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:27 2022] GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:27.518911 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.objects.instance [None req-bdbbc0b3-c7a5-40a7-b2cc-119f4f21d8c2 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lazy-loading 'services' on Instance uuid de8d1496-5f71-442d-b1b0-712a7b4f598d {{(pid=129964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:45:27.536069 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-f29b0f2d-cadd-4ff7-ab64-951fa0ed80b3 req-484f2bca-0f8e-4d89-bd37-fea14c278cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3243af5d-9b7f-4839-9877-cf6edb147c8b", "tag": "d4da0a83-078e-472f-880d-48ba7a21c476"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:45:27.548853 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-f29b0f2d-cadd-4ff7-ab64-951fa0ed80b3 req-484f2bca-0f8e-4d89-bd37-fea14c278cd8 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:27.549570 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-f29b0f2d-cadd-4ff7-ab64-951fa0ed80b3 req-484f2bca-0f8e-4d89-bd37-fea14c278cd8 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:27.550373 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-f29b0f2d-cadd-4ff7-ab64-951fa0ed80b3 req-484f2bca-0f8e-4d89-bd37-fea14c278cd8 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:27.564560 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-f29b0f2d-cadd-4ff7-ab64-951fa0ed80b3 req-484f2bca-0f8e-4d89-bd37-fea14c278cd8 service nova] Creating event network-changed:d4da0a83-078e-472f-880d-48ba7a21c476 for instance 3243af5d-9b7f-4839-9877-cf6edb147c8b on hv-cinder-85032 Aug 07 22:45:27.570747 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-f29b0f2d-cadd-4ff7-ab64-951fa0ed80b3 req-484f2bca-0f8e-4d89-bd37-fea14c278cd8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044688 Aug 07 22:45:27.572147 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 412/840] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:45:27.729968 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-bdbbc0b3-c7a5-40a7-b2cc-119f4f21d8c2 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "DELETE /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d/os-volume_attachments/1534df5c-a575-427b-84ef-ecc7689a9034" status: 202 len: 0 microversion: 2.1 time: 0.372770 Aug 07 22:45:27.732394 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 429/841] 10.222.0.30 () {58 vars in 1416 bytes} [Sun Aug 7 22:45:27 2022] DELETE /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d/os-volume_attachments/1534df5c-a575-427b-84ef-ecc7689a9034 => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 22:45:27.741949 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-8730b699-0c27-4095-9c3f-dabe139c0e87 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:27.744898 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-8730b699-0c27-4095-9c3f-dabe139c0e87 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:27.751205 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8730b699-0c27-4095-9c3f-dabe139c0e87 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:27.752055 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8730b699-0c27-4095-9c3f-dabe139c0e87 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:27.752552 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8730b699-0c27-4095-9c3f-dabe139c0e87 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:27.753029 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8730b699-0c27-4095-9c3f-dabe139c0e87 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:27.753482 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8730b699-0c27-4095-9c3f-dabe139c0e87 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:27.753925 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8730b699-0c27-4095-9c3f-dabe139c0e87 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:27.786746 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-8730b699-0c27-4095-9c3f-dabe139c0e87 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049217 Aug 07 22:45:27.791280 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 413/842] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 22:45:27 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:45:27.850606 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-969ccec4-2176-4ddf-9bd1-46cdb2ce6fde req-1c12fd6a-13b5-42df-93c3-f47587e5803b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de8d1496-5f71-442d-b1b0-712a7b4f598d", "tag": "332a7e9e-deb8-4c55-afbc-6a7faca02b5e"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:45:27.861379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-969ccec4-2176-4ddf-9bd1-46cdb2ce6fde req-1c12fd6a-13b5-42df-93c3-f47587e5803b service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:27.862242 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-969ccec4-2176-4ddf-9bd1-46cdb2ce6fde req-1c12fd6a-13b5-42df-93c3-f47587e5803b service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:27.863135 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-969ccec4-2176-4ddf-9bd1-46cdb2ce6fde req-1c12fd6a-13b5-42df-93c3-f47587e5803b service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:27.877564 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-969ccec4-2176-4ddf-9bd1-46cdb2ce6fde req-1c12fd6a-13b5-42df-93c3-f47587e5803b service nova] Creating event network-changed:332a7e9e-deb8-4c55-afbc-6a7faca02b5e for instance de8d1496-5f71-442d-b1b0-712a7b4f598d on hv-cinder-85032 Aug 07 22:45:27.884371 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-969ccec4-2176-4ddf-9bd1-46cdb2ce6fde req-1c12fd6a-13b5-42df-93c3-f47587e5803b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036757 Aug 07 22:45:27.885602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 430/843] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:45:28.507494 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-4d959c00-aa7d-4997-b5cc-91de4f1aeeb5 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:28.508456 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-4d959c00-aa7d-4997-b5cc-91de4f1aeeb5 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] [instance: 99d7a54f-8639-45d1-a003-6b122c0218af] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:28.515282 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4d959c00-aa7d-4997-b5cc-91de4f1aeeb5 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:28.515764 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4d959c00-aa7d-4997-b5cc-91de4f1aeeb5 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:28.516290 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4d959c00-aa7d-4997-b5cc-91de4f1aeeb5 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:28.517017 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4d959c00-aa7d-4997-b5cc-91de4f1aeeb5 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:28.517471 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4d959c00-aa7d-4997-b5cc-91de4f1aeeb5 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:28.517891 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4d959c00-aa7d-4997-b5cc-91de4f1aeeb5 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:28.678819 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-4d959c00-aa7d-4997-b5cc-91de4f1aeeb5 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097f69347f5a460ea7650d9854260e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0a4d9a434e41cab6cdc7e20fd8b0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:28.687272 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-4d959c00-aa7d-4997-b5cc-91de4f1aeeb5 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] 10.222.0.30 "GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af" status: 200 len: 1315 microversion: 2.1 time: 0.184503 Aug 07 22:45:28.688350 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 414/844] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:28 2022] GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:28.800085 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-36ce857a-7baa-4735-aa9e-28b5d708b811 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:28.803274 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-36ce857a-7baa-4735-aa9e-28b5d708b811 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:28.810836 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-36ce857a-7baa-4735-aa9e-28b5d708b811 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:28.811404 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-36ce857a-7baa-4735-aa9e-28b5d708b811 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:28.812220 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-36ce857a-7baa-4735-aa9e-28b5d708b811 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:28.812988 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-36ce857a-7baa-4735-aa9e-28b5d708b811 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:28.813504 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-36ce857a-7baa-4735-aa9e-28b5d708b811 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:28.814181 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-36ce857a-7baa-4735-aa9e-28b5d708b811 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:28.853961 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-36ce857a-7baa-4735-aa9e-28b5d708b811 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058845 Aug 07 22:45:28.855095 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 431/845] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 22:45:28 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:45:29.003459 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-11b84b8d-1f27-447f-a237-ed09a1fb269c req-2abe193f-641b-4f5f-9e63-5122dbf654d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d7a54f-8639-45d1-a003-6b122c0218af", "name": "network-vif-plugged", "status": "completed", "tag": "878bacfc-d8d6-45e3-91bc-b10fc42251c5"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:45:29.014682 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-11b84b8d-1f27-447f-a237-ed09a1fb269c req-2abe193f-641b-4f5f-9e63-5122dbf654d0 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:29.015272 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-11b84b8d-1f27-447f-a237-ed09a1fb269c req-2abe193f-641b-4f5f-9e63-5122dbf654d0 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:29.015735 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-11b84b8d-1f27-447f-a237-ed09a1fb269c req-2abe193f-641b-4f5f-9e63-5122dbf654d0 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:29.027190 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-11b84b8d-1f27-447f-a237-ed09a1fb269c req-2abe193f-641b-4f5f-9e63-5122dbf654d0 service nova] Creating event network-vif-plugged:878bacfc-d8d6-45e3-91bc-b10fc42251c5 for instance 99d7a54f-8639-45d1-a003-6b122c0218af on hv-cinder-85032 Aug 07 22:45:29.031990 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-11b84b8d-1f27-447f-a237-ed09a1fb269c req-2abe193f-641b-4f5f-9e63-5122dbf654d0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032351 Aug 07 22:45:29.032626 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 415/846] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:45:29.708576 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a87f0bd8-ca50-4102-b2ac-4d6c315a491a tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:29.709105 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a87f0bd8-ca50-4102-b2ac-4d6c315a491a tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] [instance: 99d7a54f-8639-45d1-a003-6b122c0218af] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:29.715880 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a87f0bd8-ca50-4102-b2ac-4d6c315a491a tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:29.716392 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a87f0bd8-ca50-4102-b2ac-4d6c315a491a tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:29.716823 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a87f0bd8-ca50-4102-b2ac-4d6c315a491a tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:29.717497 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a87f0bd8-ca50-4102-b2ac-4d6c315a491a tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:29.717941 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a87f0bd8-ca50-4102-b2ac-4d6c315a491a tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:29.718358 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a87f0bd8-ca50-4102-b2ac-4d6c315a491a tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:29.763705 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=10 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:45:29.846825 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-a87f0bd8-ca50-4102-b2ac-4d6c315a491a tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097f69347f5a460ea7650d9854260e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0a4d9a434e41cab6cdc7e20fd8b0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:29.854398 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a87f0bd8-ca50-4102-b2ac-4d6c315a491a tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] 10.222.0.30 "GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af" status: 200 len: 1315 microversion: 2.1 time: 0.149757 Aug 07 22:45:29.854955 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 432/847] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:29 2022] GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:29.863352 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=2 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:45:29.864251 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=12 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:45:29.869397 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-84003250-dfe6-4dda-a17a-f0016b955346 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:29.871747 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-84003250-dfe6-4dda-a17a-f0016b955346 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:29.877936 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-84003250-dfe6-4dda-a17a-f0016b955346 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:29.878415 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-84003250-dfe6-4dda-a17a-f0016b955346 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:29.878846 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-84003250-dfe6-4dda-a17a-f0016b955346 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:29.879540 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-84003250-dfe6-4dda-a17a-f0016b955346 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:29.880051 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-84003250-dfe6-4dda-a17a-f0016b955346 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:29.880499 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-84003250-dfe6-4dda-a17a-f0016b955346 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:29.909245 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-84003250-dfe6-4dda-a17a-f0016b955346 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047230 Aug 07 22:45:29.909800 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 416/848] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 22:45:29 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 22:45:29.920351 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-8ef2a56a-27cc-4658-858a-6e5ffee9c124 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:29.920852 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-8ef2a56a-27cc-4658-858a-6e5ffee9c124 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:29.926790 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8ef2a56a-27cc-4658-858a-6e5ffee9c124 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:29.927270 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8ef2a56a-27cc-4658-858a-6e5ffee9c124 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:29.927714 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8ef2a56a-27cc-4658-858a-6e5ffee9c124 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:29.928430 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8ef2a56a-27cc-4658-858a-6e5ffee9c124 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:29.928883 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8ef2a56a-27cc-4658-858a-6e5ffee9c124 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:29.929309 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-8ef2a56a-27cc-4658-858a-6e5ffee9c124 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:30.004887 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-8ef2a56a-27cc-4658-858a-6e5ffee9c124 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] HTTP exception thrown: Instance de8d1496-5f71-442d-b1b0-712a7b4f598d is not attached to volume 1534df5c-a575-427b-84ef-ecc7689a9034 Aug 07 22:45:30.018488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-8ef2a56a-27cc-4658-858a-6e5ffee9c124 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Request method failure captured: Aug 07 22:45:30.018488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: DELETE /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d/os-volume_attachments/1534df5c-a575-427b-84ef-ecc7689a9034 HTTP/1.1 Aug 07 22:45:30.018488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:45:30.018488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:45:30.018488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:45:30.018488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:45:30.018488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:45:30.018488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:45:30.018488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:45:30.018488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:45:30.018488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8D_2aPFDHeV8sB8mI83oith5RRjFfSMFfojSDojVk7iBGPXmq0apYvBhz-EsBxaq3D2usd_e6gM-nEnrQZdFDbhsGmi13Zvv_GmtFX3wwtP81-whVE1dIiFyxDlmtPlCgtlBHRceuA7HR1L3zwpf9ABcRA9nXFQV0wDtSkIJbPb_0GY Aug 07 22:45:30.018488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:45:30.018488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:45:30.018488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:45:30.018488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:45:30.018488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:45:30.018488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:45:30.018488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: bcc9a378e7ba4206baaa7bcc683606ca Aug 07 22:45:30.018488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-TestMinimumBasicScenario-768966540 Aug 07 22:45:30.018488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:45:30.018488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:45:30.021356 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bcc9a378e7ba4206baaa7bcc683606ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bcc9a378e7ba4206baaa7bcc683606ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bcc9a378e7ba4206baaa7bcc683606ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bcc9a378e7ba4206baaa7bcc683606ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:45:30.021356 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-TestMinimumBasicScenario-768966540 Aug 07 22:45:30.021356 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: bcc9a378e7ba4206baaa7bcc683606ca Aug 07 22:45:30.021356 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-TestMinimumBasicScenario-768966540 Aug 07 22:45:30.021356 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-TestMinimumBasicScenario-768966540-project Aug 07 22:45:30.021356 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:45:30.021356 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:45:30.021356 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: acf297d1f1f244dd997992583189c127 Aug 07 22:45:30.021356 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-TestMinimumBasicScenario-768966540-project Aug 07 22:45:30.021356 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: > Aug 07 22:45:30.021356 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Instance de8d1496-5f71-442d-b1b0-712a7b4f598d is not attached to volume 1534df5c-a575-427b-84ef-ecc7689a9034 Aug 07 22:45:30.022253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'server_id': 'de8d1496-5f71-442d-b1b0-712a7b4f598d', 'id': '1534df5c-a575-427b-84ef-ecc7689a9034'} Aug 07 22:45:30.022253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:45:30.022253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:45:30.022253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 07 22:45:30.022253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 07 22:45:30.022253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 22:45:30.022253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 22:45:30.022253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 07 22:45:30.022253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 07 22:45:30.022253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1534df5c-a575-427b-84ef-ecc7689a9034. Aug 07 22:45:30.022253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:45:30.022253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:45:30.022253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:45:30.022253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:45:30.022253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:45:30.022253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:45:30.022253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:45:30.022253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:45:30.022253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:45:30.024174 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:45:30.024174 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 07 22:45:30.024174 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 07 22:45:30.024174 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de8d1496-5f71-442d-b1b0-712a7b4f598d is not attached to volume 1534df5c-a575-427b-84ef-ecc7689a9034 Aug 07 22:45:30.024174 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:45:30.024174 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:45:30.024174 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:45:30.024174 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:45:30.024174 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:45:30.024174 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:45:30.024174 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:45:30.024174 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:45:30.024174 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de8d1496-5f71-442d-b1b0-712a7b4f598d is not attached to volume 1534df5c-a575-427b-84ef-ecc7689a9034 Aug 07 22:45:30.024174 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:45:30.024174 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-8ef2a56a-27cc-4658-858a-6e5ffee9c124 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Returning 404 to user: Instance de8d1496-5f71-442d-b1b0-712a7b4f598d is not attached to volume 1534df5c-a575-427b-84ef-ecc7689a9034 {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:45:30.025415 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-8ef2a56a-27cc-4658-858a-6e5ffee9c124 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "DELETE /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d/os-volume_attachments/1534df5c-a575-427b-84ef-ecc7689a9034" status: 404 len: 154 microversion: 2.1 time: 0.103748 Aug 07 22:45:30.025415 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 433/849] 10.222.0.30 () {58 vars in 1416 bytes} [Sun Aug 7 22:45:29 2022] DELETE /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d/os-volume_attachments/1534df5c-a575-427b-84ef-ecc7689a9034 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:45:30.874800 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-f28c76f8-8f0c-421b-b3b0-5f824d0d0fcf tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:30.875368 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-f28c76f8-8f0c-421b-b3b0-5f824d0d0fcf tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] [instance: 99d7a54f-8639-45d1-a003-6b122c0218af] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:30.882017 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f28c76f8-8f0c-421b-b3b0-5f824d0d0fcf tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:30.882490 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f28c76f8-8f0c-421b-b3b0-5f824d0d0fcf tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:30.883537 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f28c76f8-8f0c-421b-b3b0-5f824d0d0fcf tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:30.884286 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f28c76f8-8f0c-421b-b3b0-5f824d0d0fcf tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:30.884738 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f28c76f8-8f0c-421b-b3b0-5f824d0d0fcf tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:30.885155 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f28c76f8-8f0c-421b-b3b0-5f824d0d0fcf tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:31.020547 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f28c76f8-8f0c-421b-b3b0-5f824d0d0fcf tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097f69347f5a460ea7650d9854260e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0a4d9a434e41cab6cdc7e20fd8b0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:31.029283 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-f28c76f8-8f0c-421b-b3b0-5f824d0d0fcf tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] 10.222.0.30 "GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af" status: 200 len: 1464 microversion: 2.1 time: 0.158525 Aug 07 22:45:31.029847 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 417/850] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:30 2022] GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af => generated 1464 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:31.074005 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-5f62d054-7071-4bf3-aa2d-7b6d683e6e71 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:31.074483 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-5f62d054-7071-4bf3-aa2d-7b6d683e6e71 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] [instance: 99d7a54f-8639-45d1-a003-6b122c0218af] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:31.080882 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5f62d054-7071-4bf3-aa2d-7b6d683e6e71 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:31.081364 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5f62d054-7071-4bf3-aa2d-7b6d683e6e71 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:31.081799 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5f62d054-7071-4bf3-aa2d-7b6d683e6e71 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:31.082486 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5f62d054-7071-4bf3-aa2d-7b6d683e6e71 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:31.082934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5f62d054-7071-4bf3-aa2d-7b6d683e6e71 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:31.083349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5f62d054-7071-4bf3-aa2d-7b6d683e6e71 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:31.109786 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-5f62d054-7071-4bf3-aa2d-7b6d683e6e71 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] [instance: 99d7a54f-8639-45d1-a003-6b122c0218af] Going to try to terminate instance {{(pid=129964) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 22:45:31.136271 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:45:31.292352 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-fff71adb-1839-4dc1-8418-7f87892ca8c7 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:31.292861 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-fff71adb-1839-4dc1-8418-7f87892ca8c7 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:31.299450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fff71adb-1839-4dc1-8418-7f87892ca8c7 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:31.299923 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fff71adb-1839-4dc1-8418-7f87892ca8c7 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:31.300390 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fff71adb-1839-4dc1-8418-7f87892ca8c7 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:31.301088 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fff71adb-1839-4dc1-8418-7f87892ca8c7 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:31.301561 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fff71adb-1839-4dc1-8418-7f87892ca8c7 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:31.301978 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fff71adb-1839-4dc1-8418-7f87892ca8c7 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:31.330395 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-fff71adb-1839-4dc1-8418-7f87892ca8c7 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Going to try to terminate instance {{(pid=129965) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 22:45:31.386363 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-5f62d054-7071-4bf3-aa2d-7b6d683e6e71 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] 10.222.0.30 "DELETE /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af" status: 204 len: 0 microversion: 2.1 time: 0.316246 Aug 07 22:45:31.387116 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 434/851] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:45:31 2022] DELETE /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 22:45:31.395362 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-29c26435-30e5-4fe5-984d-3e0765fa5b71 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:31.396225 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-29c26435-30e5-4fe5-984d-3e0765fa5b71 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] [instance: 99d7a54f-8639-45d1-a003-6b122c0218af] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:31.402192 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-29c26435-30e5-4fe5-984d-3e0765fa5b71 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:31.402663 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-29c26435-30e5-4fe5-984d-3e0765fa5b71 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:31.403089 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-29c26435-30e5-4fe5-984d-3e0765fa5b71 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:31.403784 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-29c26435-30e5-4fe5-984d-3e0765fa5b71 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:31.404253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-29c26435-30e5-4fe5-984d-3e0765fa5b71 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:31.404694 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-29c26435-30e5-4fe5-984d-3e0765fa5b71 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:31.539930 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-29c26435-30e5-4fe5-984d-3e0765fa5b71 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097f69347f5a460ea7650d9854260e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0a4d9a434e41cab6cdc7e20fd8b0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:31.547383 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-29c26435-30e5-4fe5-984d-3e0765fa5b71 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] 10.222.0.30 "GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af" status: 200 len: 1470 microversion: 2.1 time: 0.155992 Aug 07 22:45:31.547945 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 435/852] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:31 2022] GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:45:31.638469 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-fff71adb-1839-4dc1-8418-7f87892ca8c7 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "DELETE /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 204 len: 0 microversion: 2.1 time: 0.349750 Aug 07 22:45:31.638973 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 418/853] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:45:31 2022] DELETE /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 22:45:31.646989 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-98959b03-3411-4e48-bb9c-9e1e569c63c6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:31.647593 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-98959b03-3411-4e48-bb9c-9e1e569c63c6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:31.653781 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-98959b03-3411-4e48-bb9c-9e1e569c63c6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:31.654257 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-98959b03-3411-4e48-bb9c-9e1e569c63c6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:31.654715 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-98959b03-3411-4e48-bb9c-9e1e569c63c6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:31.655395 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-98959b03-3411-4e48-bb9c-9e1e569c63c6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:31.655842 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-98959b03-3411-4e48-bb9c-9e1e569c63c6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:31.656291 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-98959b03-3411-4e48-bb9c-9e1e569c63c6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:31.783206 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-98959b03-3411-4e48-bb9c-9e1e569c63c6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:31.791089 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-98959b03-3411-4e48-bb9c-9e1e569c63c6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1554 microversion: 2.1 time: 0.147921 Aug 07 22:45:31.791648 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 436/854] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:31 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:32.571118 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d020d29a-9849-4049-a72c-130898e378fa tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:32.572085 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-d020d29a-9849-4049-a72c-130898e378fa tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] [instance: 99d7a54f-8639-45d1-a003-6b122c0218af] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:32.578493 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d020d29a-9849-4049-a72c-130898e378fa tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:32.578976 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d020d29a-9849-4049-a72c-130898e378fa tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:32.579413 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d020d29a-9849-4049-a72c-130898e378fa tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:32.580135 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d020d29a-9849-4049-a72c-130898e378fa tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:32.580591 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d020d29a-9849-4049-a72c-130898e378fa tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:32.581018 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d020d29a-9849-4049-a72c-130898e378fa tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:32.715862 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-d020d29a-9849-4049-a72c-130898e378fa tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097f69347f5a460ea7650d9854260e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0a4d9a434e41cab6cdc7e20fd8b0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:32.719354 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:45:32.723716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-d020d29a-9849-4049-a72c-130898e378fa tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] 10.222.0.30 "GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af" status: 200 len: 1470 microversion: 2.1 time: 0.157627 Aug 07 22:45:32.724315 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 419/855] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:32 2022] GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:32.811724 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-69f1dfe3-aaa4-4b24-9c44-523d0f126bb5 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:32.812363 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-69f1dfe3-aaa4-4b24-9c44-523d0f126bb5 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:32.818734 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-69f1dfe3-aaa4-4b24-9c44-523d0f126bb5 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:32.819209 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-69f1dfe3-aaa4-4b24-9c44-523d0f126bb5 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:32.819640 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-69f1dfe3-aaa4-4b24-9c44-523d0f126bb5 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:32.821022 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-69f1dfe3-aaa4-4b24-9c44-523d0f126bb5 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:32.821536 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-69f1dfe3-aaa4-4b24-9c44-523d0f126bb5 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:32.821910 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-69f1dfe3-aaa4-4b24-9c44-523d0f126bb5 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:32.948103 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-69f1dfe3-aaa4-4b24-9c44-523d0f126bb5 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:32.955508 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-69f1dfe3-aaa4-4b24-9c44-523d0f126bb5 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1554 microversion: 2.1 time: 0.147666 Aug 07 22:45:32.956091 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 437/856] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:32 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:33.744870 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-8cbae79f-b0fc-44c1-a04a-0a3bfa66853b tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:33.745480 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-8cbae79f-b0fc-44c1-a04a-0a3bfa66853b tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] [instance: 99d7a54f-8639-45d1-a003-6b122c0218af] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:33.752603 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8cbae79f-b0fc-44c1-a04a-0a3bfa66853b tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:33.753085 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8cbae79f-b0fc-44c1-a04a-0a3bfa66853b tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:33.753522 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8cbae79f-b0fc-44c1-a04a-0a3bfa66853b tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:33.754211 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8cbae79f-b0fc-44c1-a04a-0a3bfa66853b tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:33.754666 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8cbae79f-b0fc-44c1-a04a-0a3bfa66853b tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:33.755089 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8cbae79f-b0fc-44c1-a04a-0a3bfa66853b tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:33.886003 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8cbae79f-b0fc-44c1-a04a-0a3bfa66853b tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097f69347f5a460ea7650d9854260e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0a4d9a434e41cab6cdc7e20fd8b0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:33.893655 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-8cbae79f-b0fc-44c1-a04a-0a3bfa66853b tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] 10.222.0.30 "GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af" status: 200 len: 1470 microversion: 2.1 time: 0.152752 Aug 07 22:45:33.894222 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 420/857] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:33 2022] GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:33.976380 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-87a1036a-cb61-4d28-acb5-e84b0bc5e4d6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:33.977023 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-87a1036a-cb61-4d28-acb5-e84b0bc5e4d6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:33.983359 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-87a1036a-cb61-4d28-acb5-e84b0bc5e4d6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:33.983835 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-87a1036a-cb61-4d28-acb5-e84b0bc5e4d6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:33.984305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-87a1036a-cb61-4d28-acb5-e84b0bc5e4d6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:33.984990 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-87a1036a-cb61-4d28-acb5-e84b0bc5e4d6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:33.985439 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-87a1036a-cb61-4d28-acb5-e84b0bc5e4d6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:33.985857 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-87a1036a-cb61-4d28-acb5-e84b0bc5e4d6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:34.112243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-87a1036a-cb61-4d28-acb5-e84b0bc5e4d6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:34.120103 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-87a1036a-cb61-4d28-acb5-e84b0bc5e4d6 tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1554 microversion: 2.1 time: 0.147698 Aug 07 22:45:34.120723 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 438/858] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:33 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:34.882582 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-ef6e5f54-fc7f-4a9a-b6a4-8e2f2121fa7d req-4c77e208-6827-407b-a538-5152dc7d56f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d7a54f-8639-45d1-a003-6b122c0218af", "name": "network-vif-deleted", "tag": "878bacfc-d8d6-45e3-91bc-b10fc42251c5"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:45:34.894322 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-ef6e5f54-fc7f-4a9a-b6a4-8e2f2121fa7d req-4c77e208-6827-407b-a538-5152dc7d56f7 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:34.895009 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-ef6e5f54-fc7f-4a9a-b6a4-8e2f2121fa7d req-4c77e208-6827-407b-a538-5152dc7d56f7 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:34.895442 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-ef6e5f54-fc7f-4a9a-b6a4-8e2f2121fa7d req-4c77e208-6827-407b-a538-5152dc7d56f7 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:34.914645 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-5c42c2f6-2314-4902-81e7-92c58ed32804 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:34.915578 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-5c42c2f6-2314-4902-81e7-92c58ed32804 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] [instance: 99d7a54f-8639-45d1-a003-6b122c0218af] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:34.921585 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-ef6e5f54-fc7f-4a9a-b6a4-8e2f2121fa7d req-4c77e208-6827-407b-a538-5152dc7d56f7 service nova] Creating event network-vif-deleted:878bacfc-d8d6-45e3-91bc-b10fc42251c5 for instance 99d7a54f-8639-45d1-a003-6b122c0218af on hv-cinder-85032 Aug 07 22:45:34.925111 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5c42c2f6-2314-4902-81e7-92c58ed32804 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:34.927745 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5c42c2f6-2314-4902-81e7-92c58ed32804 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:34.928503 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5c42c2f6-2314-4902-81e7-92c58ed32804 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:34.929438 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5c42c2f6-2314-4902-81e7-92c58ed32804 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:34.932882 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5c42c2f6-2314-4902-81e7-92c58ed32804 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:34.933573 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5c42c2f6-2314-4902-81e7-92c58ed32804 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:34.936722 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-ef6e5f54-fc7f-4a9a-b6a4-8e2f2121fa7d req-4c77e208-6827-407b-a538-5152dc7d56f7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053470 Aug 07 22:45:34.938596 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 421/859] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:45:35.012681 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-5c42c2f6-2314-4902-81e7-92c58ed32804 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097f69347f5a460ea7650d9854260e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0a4d9a434e41cab6cdc7e20fd8b0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:35.026246 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-5c42c2f6-2314-4902-81e7-92c58ed32804 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] 10.222.0.30 "GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af" status: 200 len: 1428 microversion: 2.1 time: 0.115206 Aug 07 22:45:35.026855 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 439/860] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:34 2022] GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af => generated 1428 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:45:35.142278 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-bc02a245-959f-4657-80e7-6183f26970ad tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:35.143055 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-bc02a245-959f-4657-80e7-6183f26970ad tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:35.149956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bc02a245-959f-4657-80e7-6183f26970ad tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:35.150527 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bc02a245-959f-4657-80e7-6183f26970ad tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:35.151058 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bc02a245-959f-4657-80e7-6183f26970ad tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:35.151829 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bc02a245-959f-4657-80e7-6183f26970ad tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:35.152380 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bc02a245-959f-4657-80e7-6183f26970ad tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:35.152869 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bc02a245-959f-4657-80e7-6183f26970ad tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:35.418362 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-bc02a245-959f-4657-80e7-6183f26970ad tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:35.425804 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-bc02a245-959f-4657-80e7-6183f26970ad tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1512 microversion: 2.1 time: 0.287853 Aug 07 22:45:35.426524 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 422/861] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:35 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1512 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:35.468383 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-1159d2ae-2706-44a4-b257-d21e1fed7ac7 req-5d578d79-4bc6-4aa1-aa5a-019bf19c70dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de8d1496-5f71-442d-b1b0-712a7b4f598d", "name": "network-vif-deleted", "tag": "332a7e9e-deb8-4c55-afbc-6a7faca02b5e"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:45:35.478479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-1159d2ae-2706-44a4-b257-d21e1fed7ac7 req-5d578d79-4bc6-4aa1-aa5a-019bf19c70dc service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:35.478948 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-1159d2ae-2706-44a4-b257-d21e1fed7ac7 req-5d578d79-4bc6-4aa1-aa5a-019bf19c70dc service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:35.479379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-1159d2ae-2706-44a4-b257-d21e1fed7ac7 req-5d578d79-4bc6-4aa1-aa5a-019bf19c70dc service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:35.490572 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-1159d2ae-2706-44a4-b257-d21e1fed7ac7 req-5d578d79-4bc6-4aa1-aa5a-019bf19c70dc service nova] Creating event network-vif-deleted:332a7e9e-deb8-4c55-afbc-6a7faca02b5e for instance de8d1496-5f71-442d-b1b0-712a7b4f598d on hv-cinder-85032 Aug 07 22:45:35.496083 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-1159d2ae-2706-44a4-b257-d21e1fed7ac7 req-5d578d79-4bc6-4aa1-aa5a-019bf19c70dc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032309 Aug 07 22:45:35.496700 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 440/862] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:45:36.047912 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-cc083ae2-0cb6-4d07-a0c6-d8e3f5a58e76 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:36.048546 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-cc083ae2-0cb6-4d07-a0c6-d8e3f5a58e76 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] [instance: 99d7a54f-8639-45d1-a003-6b122c0218af] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:36.055446 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cc083ae2-0cb6-4d07-a0c6-d8e3f5a58e76 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:36.056130 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cc083ae2-0cb6-4d07-a0c6-d8e3f5a58e76 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:36.056569 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cc083ae2-0cb6-4d07-a0c6-d8e3f5a58e76 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:36.057262 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cc083ae2-0cb6-4d07-a0c6-d8e3f5a58e76 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:36.057715 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cc083ae2-0cb6-4d07-a0c6-d8e3f5a58e76 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:36.058138 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cc083ae2-0cb6-4d07-a0c6-d8e3f5a58e76 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:36.088726 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cc083ae2-0cb6-4d07-a0c6-d8e3f5a58e76 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:36.089205 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cc083ae2-0cb6-4d07-a0c6-d8e3f5a58e76 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:36.089644 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cc083ae2-0cb6-4d07-a0c6-d8e3f5a58e76 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:36.090088 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.objects.instance [None req-cc083ae2-0cb6-4d07-a0c6-d8e3f5a58e76 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lazy-loading 'fault' on Instance uuid 99d7a54f-8639-45d1-a003-6b122c0218af {{(pid=129965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:45:36.132674 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-cc083ae2-0cb6-4d07-a0c6-d8e3f5a58e76 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097f69347f5a460ea7650d9854260e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0a4d9a434e41cab6cdc7e20fd8b0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:36.140988 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-cc083ae2-0cb6-4d07-a0c6-d8e3f5a58e76 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] 10.222.0.30 "GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af" status: 200 len: 1305 microversion: 2.1 time: 0.096986 Aug 07 22:45:36.141555 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 423/863] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:36 2022] GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:36.449331 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-ec4c022d-314d-4490-8575-60ddbd4ffd5a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:36.450026 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-ec4c022d-314d-4490-8575-60ddbd4ffd5a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:36.456200 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ec4c022d-314d-4490-8575-60ddbd4ffd5a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:36.456658 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ec4c022d-314d-4490-8575-60ddbd4ffd5a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:36.457090 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ec4c022d-314d-4490-8575-60ddbd4ffd5a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:36.457772 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ec4c022d-314d-4490-8575-60ddbd4ffd5a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:36.458249 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ec4c022d-314d-4490-8575-60ddbd4ffd5a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:36.458669 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ec4c022d-314d-4490-8575-60ddbd4ffd5a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:36.490692 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ec4c022d-314d-4490-8575-60ddbd4ffd5a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:36.491161 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ec4c022d-314d-4490-8575-60ddbd4ffd5a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:36.491593 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ec4c022d-314d-4490-8575-60ddbd4ffd5a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:36.492093 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.objects.instance [None req-ec4c022d-314d-4490-8575-60ddbd4ffd5a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lazy-loading 'fault' on Instance uuid de8d1496-5f71-442d-b1b0-712a7b4f598d {{(pid=129964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:45:36.540883 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-ec4c022d-314d-4490-8575-60ddbd4ffd5a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf297d1f1f244dd997992583189c127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc9a378e7ba4206baaa7bcc683606ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:36.548324 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-ec4c022d-314d-4490-8575-60ddbd4ffd5a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 200 len: 1349 microversion: 2.1 time: 0.103917 Aug 07 22:45:36.556962 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 441/864] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:36 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 1349 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:37.161987 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d026c8b3-aad3-44fe-bef2-0638f10fcf38 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:37.162652 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-d026c8b3-aad3-44fe-bef2-0638f10fcf38 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] [instance: 99d7a54f-8639-45d1-a003-6b122c0218af] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:37.169018 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d026c8b3-aad3-44fe-bef2-0638f10fcf38 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:37.169479 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d026c8b3-aad3-44fe-bef2-0638f10fcf38 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:37.169917 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d026c8b3-aad3-44fe-bef2-0638f10fcf38 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:37.170604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d026c8b3-aad3-44fe-bef2-0638f10fcf38 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:37.171062 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d026c8b3-aad3-44fe-bef2-0638f10fcf38 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:37.171494 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d026c8b3-aad3-44fe-bef2-0638f10fcf38 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:37.184623 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.wsgi [None req-d026c8b3-aad3-44fe-bef2-0638f10fcf38 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] HTTP exception thrown: Instance 99d7a54f-8639-45d1-a003-6b122c0218af could not be found. Aug 07 22:45:37.186258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d026c8b3-aad3-44fe-bef2-0638f10fcf38 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Request method failure captured: Aug 07 22:45:37.186258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: request: GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af HTTP/1.1 Aug 07 22:45:37.186258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept: application/json Aug 07 22:45:37.186258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept-Encoding: identity Aug 07 22:45:37.186258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Connection: close Aug 07 22:45:37.186258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Length: 0 Aug 07 22:45:37.186258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Type: application/json Aug 07 22:45:37.186258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Host: 10.222.0.30 Aug 07 22:45:37.186258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Openstack-System-Scope: None Aug 07 22:45:37.186258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: User-Agent: python-urllib3/1.26.11 Aug 07 22:45:37.186258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Auth-Token: gAAAAABi8EB9GwmPgjayglCbQ0I4qqpJPgOk0dvGgg87S-Nfw6u-flnAly7N06er9T1yta4eOm1dbdb2U_VS8q-Bj8h7gpln54iXw-OrY1LZ6B2RSuSu5U-KdKAXhi4neVXY0Rd4RTc9F4g0tru59ZdXmWBc-CBNYHMcnjJ2Mu2tntAme8-C2jw Aug 07 22:45:37.186258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Id: None Aug 07 22:45:37.186258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Name: None Aug 07 22:45:37.186258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Identity-Status: Confirmed Aug 07 22:45:37.186258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Is-Admin-Project: True Aug 07 22:45:37.186258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Id: default Aug 07 22:45:37.186258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Name: Default Aug 07 22:45:37.186258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Id: ad0a4d9a434e41cab6cdc7e20fd8b0bb Aug 07 22:45:37.186258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Name: tempest-VolumesNegativeTest-14992085 Aug 07 22:45:37.186258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Role: reader,member Aug 07 22:45:37.186258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Roles: reader,member Aug 07 22:45:37.187884 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ad0a4d9a434e41cab6cdc7e20fd8b0bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ad0a4d9a434e41cab6cdc7e20fd8b0bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ad0a4d9a434e41cab6cdc7e20fd8b0bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ad0a4d9a434e41cab6cdc7e20fd8b0bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:45:37.187884 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant: tempest-VolumesNegativeTest-14992085 Aug 07 22:45:37.187884 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Id: ad0a4d9a434e41cab6cdc7e20fd8b0bb Aug 07 22:45:37.187884 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Name: tempest-VolumesNegativeTest-14992085 Aug 07 22:45:37.187884 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User: tempest-VolumesNegativeTest-14992085-project Aug 07 22:45:37.187884 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Id: default Aug 07 22:45:37.187884 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Name: Default Aug 07 22:45:37.187884 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Id: 097f69347f5a460ea7650d9854260e97 Aug 07 22:45:37.187884 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Name: tempest-VolumesNegativeTest-14992085-project Aug 07 22:45:37.187884 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: method: > Aug 07 22:45:37.187884 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: exception: Instance 99d7a54f-8639-45d1-a003-6b122c0218af could not be found. Aug 07 22:45:37.187884 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: action_args: {'id': '99d7a54f-8639-45d1-a003-6b122c0218af'} Aug 07 22:45:37.188887 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:45:37.188887 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:45:37.188887 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:45:37.188887 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:45:37.188887 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:45:37.188887 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:45:37.188887 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:45:37.188887 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:45:37.188887 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:45:37.188887 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:45:37.188887 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99d7a54f-8639-45d1-a003-6b122c0218af could not be found. Aug 07 22:45:37.188887 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:45:37.188887 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:45:37.188887 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:45:37.188887 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:45:37.188887 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:45:37.188887 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:45:37.188887 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:45:37.188887 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:45:37.188887 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:45:37.190434 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:45:37.190434 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:45:37.190434 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:45:37.190434 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:45:37.190434 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:45:37.190434 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:45:37.190434 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:45:37.190434 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d7a54f-8639-45d1-a003-6b122c0218af could not be found. Aug 07 22:45:37.190434 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:45:37.190434 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:45:37.190434 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:45:37.190434 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:45:37.190434 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:45:37.190434 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:45:37.190434 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:45:37.190434 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:45:37.190434 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d7a54f-8639-45d1-a003-6b122c0218af could not be found. Aug 07 22:45:37.190434 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:45:37.191824 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d026c8b3-aad3-44fe-bef2-0638f10fcf38 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] Returning 404 to user: Instance 99d7a54f-8639-45d1-a003-6b122c0218af could not be found. {{(pid=129965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:45:37.191824 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-d026c8b3-aad3-44fe-bef2-0638f10fcf38 tempest-VolumesNegativeTest-14992085 tempest-VolumesNegativeTest-14992085-project] 10.222.0.30 "GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af" status: 404 len: 111 microversion: 2.1 time: 0.029615 Aug 07 22:45:37.191824 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 424/865] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:37 2022] GET /compute/v2.1/servers/99d7a54f-8639-45d1-a003-6b122c0218af => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:45:37.569343 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-7573ade0-fa03-46eb-89cd-407bd724a65a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:37.569940 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-7573ade0-fa03-46eb-89cd-407bd724a65a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] [instance: de8d1496-5f71-442d-b1b0-712a7b4f598d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:37.576444 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7573ade0-fa03-46eb-89cd-407bd724a65a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:37.576919 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7573ade0-fa03-46eb-89cd-407bd724a65a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:37.577343 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7573ade0-fa03-46eb-89cd-407bd724a65a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:37.578017 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7573ade0-fa03-46eb-89cd-407bd724a65a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:37.578461 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7573ade0-fa03-46eb-89cd-407bd724a65a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:37.578874 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7573ade0-fa03-46eb-89cd-407bd724a65a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:37.592510 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-7573ade0-fa03-46eb-89cd-407bd724a65a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] HTTP exception thrown: Instance de8d1496-5f71-442d-b1b0-712a7b4f598d could not be found. Aug 07 22:45:37.594129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-7573ade0-fa03-46eb-89cd-407bd724a65a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Request method failure captured: Aug 07 22:45:37.594129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d HTTP/1.1 Aug 07 22:45:37.594129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:45:37.594129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:45:37.594129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:45:37.594129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:45:37.594129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:45:37.594129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:45:37.594129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:45:37.594129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:45:37.594129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8D_2aPFDHeV8sB8mI83oith5RRjFfSMFfojSDojVk7iBGPXmq0apYvBhz-EsBxaq3D2usd_e6gM-nEnrQZdFDbhsGmi13Zvv_GmtFX3wwtP81-whVE1dIiFyxDlmtPlCgtlBHRceuA7HR1L3zwpf9ABcRA9nXFQV0wDtSkIJbPb_0GY Aug 07 22:45:37.594129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:45:37.594129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:45:37.594129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:45:37.594129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:45:37.594129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:45:37.594129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:45:37.594129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: bcc9a378e7ba4206baaa7bcc683606ca Aug 07 22:45:37.594129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-TestMinimumBasicScenario-768966540 Aug 07 22:45:37.594129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:45:37.594129 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:45:37.595755 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bcc9a378e7ba4206baaa7bcc683606ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bcc9a378e7ba4206baaa7bcc683606ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bcc9a378e7ba4206baaa7bcc683606ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bcc9a378e7ba4206baaa7bcc683606ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:45:37.595755 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-TestMinimumBasicScenario-768966540 Aug 07 22:45:37.595755 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: bcc9a378e7ba4206baaa7bcc683606ca Aug 07 22:45:37.595755 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-TestMinimumBasicScenario-768966540 Aug 07 22:45:37.595755 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-TestMinimumBasicScenario-768966540-project Aug 07 22:45:37.595755 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:45:37.595755 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:45:37.595755 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: acf297d1f1f244dd997992583189c127 Aug 07 22:45:37.595755 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-TestMinimumBasicScenario-768966540-project Aug 07 22:45:37.595755 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: > Aug 07 22:45:37.595755 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Instance de8d1496-5f71-442d-b1b0-712a7b4f598d could not be found. Aug 07 22:45:37.595755 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': 'de8d1496-5f71-442d-b1b0-712a7b4f598d'} Aug 07 22:45:37.596916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:45:37.596916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:45:37.596916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:45:37.596916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:45:37.596916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:45:37.596916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:45:37.596916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:45:37.596916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:45:37.596916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:45:37.596916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:45:37.596916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de8d1496-5f71-442d-b1b0-712a7b4f598d could not be found. Aug 07 22:45:37.596916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:45:37.596916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:45:37.596916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:45:37.596916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:45:37.596916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:45:37.596916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:45:37.596916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:45:37.596916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:45:37.596916 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:45:37.598422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:45:37.598422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:45:37.598422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:45:37.598422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:45:37.598422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:45:37.598422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:45:37.598422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:45:37.598422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de8d1496-5f71-442d-b1b0-712a7b4f598d could not be found. Aug 07 22:45:37.598422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:45:37.598422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:45:37.598422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:45:37.598422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:45:37.598422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:45:37.598422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:45:37.598422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:45:37.598422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:45:37.598422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de8d1496-5f71-442d-b1b0-712a7b4f598d could not be found. Aug 07 22:45:37.598422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:45:37.600032 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-7573ade0-fa03-46eb-89cd-407bd724a65a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Returning 404 to user: Instance de8d1496-5f71-442d-b1b0-712a7b4f598d could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:45:37.600032 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-7573ade0-fa03-46eb-89cd-407bd724a65a tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d" status: 404 len: 111 microversion: 2.1 time: 0.030004 Aug 07 22:45:37.600032 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 442/866] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:37 2022] GET /compute/v2.1/servers/de8d1496-5f71-442d-b1b0-712a7b4f598d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:45:37.606095 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-60830bef-9437-4b7d-9d42-8a809b56667e tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] Calling method '.version_select at 0x7fc0ac42f310>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:37.684197 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-60830bef-9437-4b7d-9d42-8a809b56667e tempest-TestMinimumBasicScenario-768966540 tempest-TestMinimumBasicScenario-768966540-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1385561946" status: 202 len: 0 microversion: 2.1 time: 0.082542 Aug 07 22:45:37.684693 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 425/867] 10.222.0.30 () {58 vars in 1272 bytes} [Sun Aug 7 22:45:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1385561946 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:45:47.500362 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-06d1207f-b820-4490-8071-8c46edda1a56 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:47.500847 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-06d1207f-b820-4490-8071-8c46edda1a56 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:47.501315 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=24 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:45:47.503781 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:45:47.505950 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-cc182811-43c0-4fe0-9199-7c9cd40d4bb6 req-433d175e-3119-43d1-8eb6-c4e83782976a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93991d13-4c43-4e03-9031-2d5032989994", "tag": "2b5b8b0f-84c3-482a-be06-dd81e2a229e1"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:45:47.512883 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-06d1207f-b820-4490-8071-8c46edda1a56 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:47.515557 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-06d1207f-b820-4490-8071-8c46edda1a56 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:47.516204 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-06d1207f-b820-4490-8071-8c46edda1a56 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:47.519921 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-06d1207f-b820-4490-8071-8c46edda1a56 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:47.520757 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-06d1207f-b820-4490-8071-8c46edda1a56 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:47.521388 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-06d1207f-b820-4490-8071-8c46edda1a56 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:47.527556 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:45:47.530151 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-cc182811-43c0-4fe0-9199-7c9cd40d4bb6 req-433d175e-3119-43d1-8eb6-c4e83782976a service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:47.530831 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-cc182811-43c0-4fe0-9199-7c9cd40d4bb6 req-433d175e-3119-43d1-8eb6-c4e83782976a service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:47.531464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-cc182811-43c0-4fe0-9199-7c9cd40d4bb6 req-433d175e-3119-43d1-8eb6-c4e83782976a service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:47.543358 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-cc182811-43c0-4fe0-9199-7c9cd40d4bb6 req-433d175e-3119-43d1-8eb6-c4e83782976a service nova] Creating event network-changed:2b5b8b0f-84c3-482a-be06-dd81e2a229e1 for instance 93991d13-4c43-4e03-9031-2d5032989994 on hv-cinder-85032 Aug 07 22:45:47.549606 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-cc182811-43c0-4fe0-9199-7c9cd40d4bb6 req-433d175e-3119-43d1-8eb6-c4e83782976a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050412 Aug 07 22:45:47.550607 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 426/868] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:45:47.574433 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-06d1207f-b820-4490-8071-8c46edda1a56 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Going to try to terminate instance {{(pid=129964) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 22:45:47.896813 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-06d1207f-b820-4490-8071-8c46edda1a56 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "DELETE /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 204 len: 0 microversion: 2.1 time: 0.400295 Aug 07 22:45:47.904212 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 443/869] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:45:47 2022] DELETE /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 22:45:47.908222 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-9b8d5a86-e41b-4e7b-9c9e-e4c7e625572d tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:47.909122 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-9b8d5a86-e41b-4e7b-9c9e-e4c7e625572d tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:47.915886 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9b8d5a86-e41b-4e7b-9c9e-e4c7e625572d tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:47.916586 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9b8d5a86-e41b-4e7b-9c9e-e4c7e625572d tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:47.917196 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9b8d5a86-e41b-4e7b-9c9e-e4c7e625572d tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:47.918055 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9b8d5a86-e41b-4e7b-9c9e-e4c7e625572d tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:47.918678 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9b8d5a86-e41b-4e7b-9c9e-e4c7e625572d tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:47.919254 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-9b8d5a86-e41b-4e7b-9c9e-e4c7e625572d tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:48.083888 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-9b8d5a86-e41b-4e7b-9c9e-e4c7e625572d tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:48.092194 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-9b8d5a86-e41b-4e7b-9c9e-e4c7e625572d tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1570 microversion: 2.1 time: 0.188486 Aug 07 22:45:48.092782 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 427/870] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:47 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1570 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:45:49.114389 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-d77df2f0-211d-4c13-aa4b-254157f2e5f7 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:49.115169 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-d77df2f0-211d-4c13-aa4b-254157f2e5f7 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:49.122147 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d77df2f0-211d-4c13-aa4b-254157f2e5f7 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:49.122666 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d77df2f0-211d-4c13-aa4b-254157f2e5f7 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:49.123098 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d77df2f0-211d-4c13-aa4b-254157f2e5f7 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:49.123802 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d77df2f0-211d-4c13-aa4b-254157f2e5f7 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:49.124276 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d77df2f0-211d-4c13-aa4b-254157f2e5f7 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:49.124697 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d77df2f0-211d-4c13-aa4b-254157f2e5f7 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:49.316752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-d77df2f0-211d-4c13-aa4b-254157f2e5f7 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:49.324984 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-d77df2f0-211d-4c13-aa4b-254157f2e5f7 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1570 microversion: 2.1 time: 0.214770 Aug 07 22:45:49.325491 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 444/871] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:49 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1570 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:50.034956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-09938830-053e-4720-9be4-17bcb5b5f490 req-d34bd8a7-78b8-47f5-9fad-bebfc981fc0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93991d13-4c43-4e03-9031-2d5032989994", "name": "network-vif-deleted", "tag": "2b5b8b0f-84c3-482a-be06-dd81e2a229e1"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:45:50.046073 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-09938830-053e-4720-9be4-17bcb5b5f490 req-d34bd8a7-78b8-47f5-9fad-bebfc981fc0e service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:50.046547 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-09938830-053e-4720-9be4-17bcb5b5f490 req-d34bd8a7-78b8-47f5-9fad-bebfc981fc0e service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:50.046976 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-09938830-053e-4720-9be4-17bcb5b5f490 req-d34bd8a7-78b8-47f5-9fad-bebfc981fc0e service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:50.058651 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-09938830-053e-4720-9be4-17bcb5b5f490 req-d34bd8a7-78b8-47f5-9fad-bebfc981fc0e service nova] Creating event network-vif-deleted:2b5b8b0f-84c3-482a-be06-dd81e2a229e1 for instance 93991d13-4c43-4e03-9031-2d5032989994 on hv-cinder-85032 Aug 07 22:45:50.063338 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-09938830-053e-4720-9be4-17bcb5b5f490 req-d34bd8a7-78b8-47f5-9fad-bebfc981fc0e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032045 Aug 07 22:45:50.064005 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 428/872] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:45:50.345824 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-de8a4cbc-b0cd-4fe6-a7b8-5855ee2cffad tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:50.346439 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-de8a4cbc-b0cd-4fe6-a7b8-5855ee2cffad tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:50.354290 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-de8a4cbc-b0cd-4fe6-a7b8-5855ee2cffad tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:50.354536 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-de8a4cbc-b0cd-4fe6-a7b8-5855ee2cffad tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:50.354973 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-de8a4cbc-b0cd-4fe6-a7b8-5855ee2cffad tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:50.355672 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-de8a4cbc-b0cd-4fe6-a7b8-5855ee2cffad tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:50.356146 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-de8a4cbc-b0cd-4fe6-a7b8-5855ee2cffad tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:50.356567 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-de8a4cbc-b0cd-4fe6-a7b8-5855ee2cffad tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:50.424713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-de8a4cbc-b0cd-4fe6-a7b8-5855ee2cffad tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f2dbb97068490d924ae132224dc8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097fb8408bfb479d87e7516a93970e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:45:50.430730 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-de8a4cbc-b0cd-4fe6-a7b8-5855ee2cffad tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 200 len: 1219 microversion: 2.1 time: 0.088596 Aug 07 22:45:50.431483 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 445/873] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:50 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:45:51.453820 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-00e8d271-7224-49cb-94ae-d41fc8f9066f tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:51.454530 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-00e8d271-7224-49cb-94ae-d41fc8f9066f tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] [instance: 93991d13-4c43-4e03-9031-2d5032989994] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:45:51.460840 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-00e8d271-7224-49cb-94ae-d41fc8f9066f tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:51.461913 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-00e8d271-7224-49cb-94ae-d41fc8f9066f tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:51.462374 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-00e8d271-7224-49cb-94ae-d41fc8f9066f tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:51.463054 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-00e8d271-7224-49cb-94ae-d41fc8f9066f tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:45:51.463504 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-00e8d271-7224-49cb-94ae-d41fc8f9066f tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:45:51.463920 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-00e8d271-7224-49cb-94ae-d41fc8f9066f tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:45:51.476988 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.wsgi [None req-00e8d271-7224-49cb-94ae-d41fc8f9066f tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] HTTP exception thrown: Instance 93991d13-4c43-4e03-9031-2d5032989994 could not be found. Aug 07 22:45:51.478604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-00e8d271-7224-49cb-94ae-d41fc8f9066f tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Request method failure captured: Aug 07 22:45:51.478604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: request: GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 HTTP/1.1 Aug 07 22:45:51.478604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept: application/json Aug 07 22:45:51.478604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept-Encoding: identity Aug 07 22:45:51.478604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Connection: close Aug 07 22:45:51.478604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Length: 0 Aug 07 22:45:51.478604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Type: application/json Aug 07 22:45:51.478604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Host: 10.222.0.30 Aug 07 22:45:51.478604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Openstack-System-Scope: None Aug 07 22:45:51.478604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: User-Agent: python-urllib3/1.26.11 Aug 07 22:45:51.478604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Auth-Token: gAAAAABi8D9UpVyP5A35UHbiBnAj2keXJA1OOuFo1JazNjUCjz-MsiJ092YnttZUHYi3tbFWXaobxb60Zoihr2xw3kmDVM_a350l-Ywkkn5KO9Qn3cMjyHpcVEvy9mPKwCFveCsx1WZQVnzhMT4d4yZ2JTRM5EPH0qAkr2VV9ArHS-IAZOCpiwE Aug 07 22:45:51.478604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Id: None Aug 07 22:45:51.478604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Name: None Aug 07 22:45:51.478604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Identity-Status: Confirmed Aug 07 22:45:51.478604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Is-Admin-Project: True Aug 07 22:45:51.478604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Id: default Aug 07 22:45:51.478604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Name: Default Aug 07 22:45:51.478604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Id: 097fb8408bfb479d87e7516a93970e61 Aug 07 22:45:51.478604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Name: tempest-TestShelveInstance-1608002558 Aug 07 22:45:51.478604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Role: reader,member Aug 07 22:45:51.478604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Roles: reader,member Aug 07 22:45:51.484287 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/097fb8408bfb479d87e7516a93970e61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/097fb8408bfb479d87e7516a93970e61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/097fb8408bfb479d87e7516a93970e61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_097fb8408bfb479d87e7516a93970e61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:45:51.484287 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant: tempest-TestShelveInstance-1608002558 Aug 07 22:45:51.484287 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Id: 097fb8408bfb479d87e7516a93970e61 Aug 07 22:45:51.484287 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Name: tempest-TestShelveInstance-1608002558 Aug 07 22:45:51.484287 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User: tempest-TestShelveInstance-1608002558-project Aug 07 22:45:51.484287 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Id: default Aug 07 22:45:51.484287 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Name: Default Aug 07 22:45:51.484287 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Id: d7f2dbb97068490d924ae132224dc8ff Aug 07 22:45:51.484287 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Name: tempest-TestShelveInstance-1608002558-project Aug 07 22:45:51.484287 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: method: > Aug 07 22:45:51.484287 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: exception: Instance 93991d13-4c43-4e03-9031-2d5032989994 could not be found. Aug 07 22:45:51.484287 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: action_args: {'id': '93991d13-4c43-4e03-9031-2d5032989994'} Aug 07 22:45:51.485578 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:45:51.485578 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:45:51.485578 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:45:51.485578 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:45:51.485578 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:45:51.485578 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:45:51.485578 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:45:51.485578 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:45:51.485578 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:45:51.485578 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:45:51.485578 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93991d13-4c43-4e03-9031-2d5032989994 could not be found. Aug 07 22:45:51.485578 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:45:51.485578 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:45:51.485578 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:45:51.485578 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:45:51.485578 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:45:51.485578 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:45:51.485578 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:45:51.485578 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:45:51.485578 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:45:51.486795 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:45:51.486795 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:45:51.486795 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:45:51.486795 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:45:51.486795 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:45:51.486795 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:45:51.486795 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:45:51.486795 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93991d13-4c43-4e03-9031-2d5032989994 could not be found. Aug 07 22:45:51.486795 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:45:51.486795 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:45:51.486795 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:45:51.486795 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:45:51.486795 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:45:51.486795 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:45:51.486795 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:45:51.486795 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:45:51.486795 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93991d13-4c43-4e03-9031-2d5032989994 could not be found. Aug 07 22:45:51.486795 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:45:51.487944 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-00e8d271-7224-49cb-94ae-d41fc8f9066f tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Returning 404 to user: Instance 93991d13-4c43-4e03-9031-2d5032989994 could not be found. {{(pid=129965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:45:51.487944 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-00e8d271-7224-49cb-94ae-d41fc8f9066f tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994" status: 404 len: 111 microversion: 2.1 time: 0.031199 Aug 07 22:45:51.487944 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 429/874] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:45:51 2022] GET /compute/v2.1/servers/93991d13-4c43-4e03-9031-2d5032989994 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:45:51.683563 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-bd47f74f-5014-4a7f-a17d-859bf42b1c93 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] Calling method '.version_select at 0x7fc09fa5c700>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:45:51.747883 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-bd47f74f-5014-4a7f-a17d-859bf42b1c93 tempest-TestShelveInstance-1608002558 tempest-TestShelveInstance-1608002558-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-742047185" status: 202 len: 0 microversion: 2.1 time: 0.068672 Aug 07 22:45:51.748601 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 446/875] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Aug 7 22:45:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-742047185 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:46:04.095306 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-a153b4c3-3d2b-4e3f-88f5-f1126daac9e5 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:04.095801 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-a153b4c3-3d2b-4e3f-88f5-f1126daac9e5 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:04.098277 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=7 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:46:04.098794 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=12 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:46:04.104161 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a153b4c3-3d2b-4e3f-88f5-f1126daac9e5 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:04.104863 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a153b4c3-3d2b-4e3f-88f5-f1126daac9e5 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:04.105469 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a153b4c3-3d2b-4e3f-88f5-f1126daac9e5 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:04.106171 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a153b4c3-3d2b-4e3f-88f5-f1126daac9e5 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:04.106624 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a153b4c3-3d2b-4e3f-88f5-f1126daac9e5 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:04.107053 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a153b4c3-3d2b-4e3f-88f5-f1126daac9e5 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:04.131919 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-a153b4c3-3d2b-4e3f-88f5-f1126daac9e5 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b/ips" status: 200 len: 144 microversion: 2.1 time: 0.040389 Aug 07 22:46:04.132543 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 430/876] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Aug 7 22:46:04 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b/ips => generated 144 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:46:04.178094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=72,nova_cell1:INSERT=2 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:46:04.178846 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:46:04.182864 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-9fa66166-8d85-46a1-b080-aead4eb168d4 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-945764509", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-754102463", "security_groups": [{"name": "tempest-secgroup-smoke-1868642240"}], "block_device_mapping_v2": [{"uuid": "d1b5e438-f2ab-4e44-a5a6-ff2a2230939a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aaf0b534-ba14-4766-8d78-28b21425ddb7"}]}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:46:04.294599 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.network.neutron [None req-9fa66166-8d85-46a1-b080-aead4eb168d4 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] validate_networks() for [('aaf0b534-ba14-4766-8d78-28b21425ddb7', None, None, None, None, None)] {{(pid=129964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 22:46:04.670796 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-9fa66166-8d85-46a1-b080-aead4eb168d4 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Flavor limits 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 22:46:04.671214 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-9fa66166-8d85-46a1-b080-aead4eb168d4 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Image limits 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 22:46:04.671683 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-9fa66166-8d85-46a1-b080-aead4eb168d4 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Flavor pref 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 22:46:04.672112 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-9fa66166-8d85-46a1-b080-aead4eb168d4 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Image pref 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 22:46:04.676458 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-9fa66166-8d85-46a1-b080-aead4eb168d4 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 22:46:04.681947 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9fa66166-8d85-46a1-b080-aead4eb168d4 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:04.682533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9fa66166-8d85-46a1-b080-aead4eb168d4 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:04.682964 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9fa66166-8d85-46a1-b080-aead4eb168d4 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:04.683673 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9fa66166-8d85-46a1-b080-aead4eb168d4 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:04.684149 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9fa66166-8d85-46a1-b080-aead4eb168d4 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:04.684571 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9fa66166-8d85-46a1-b080-aead4eb168d4 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:04.702666 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-9fa66166-8d85-46a1-b080-aead4eb168d4 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Getting quotas for project 6b3cfd456d8748b3a1db990d638340af. Resources: {'cores', 'instances', 'ram'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:46:04.706720 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-9fa66166-8d85-46a1-b080-aead4eb168d4 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Getting quotas for user 394c67bcc3864bb2aca2f4faec834029 and project 6b3cfd456d8748b3a1db990d638340af. Resources: {'cores', 'instances', 'ram'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:46:04.764815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-9fa66166-8d85-46a1-b080-aead4eb168d4 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Going to run 1 instances... {{(pid=129964) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 22:46:04.766933 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-9fa66166-8d85-46a1-b080-aead4eb168d4 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: fb112b33-4a06-4ff4-832f-aa5d3310bf2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d1b5e438-f2ab-4e44-a5a6-ff2a2230939a',volume_size=None,volume_type=None)] {{(pid=129964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 22:46:05.119820 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-9fa66166-8d85-46a1-b080-aead4eb168d4 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.943101 Aug 07 22:46:05.120495 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 447/877] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 22:46:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 22:46:05.131764 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-488403a3-7c44-4e38-873b-e4c5f39ae3df tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:05.132478 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-488403a3-7c44-4e38-873b-e4c5f39ae3df tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: fb112b33-4a06-4ff4-832f-aa5d3310bf2a] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:05.188830 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-488403a3-7c44-4e38-873b-e4c5f39ae3df tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:05.195500 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-488403a3-7c44-4e38-873b-e4c5f39ae3df tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a" status: 200 len: 1093 microversion: 2.1 time: 0.068150 Aug 07 22:46:05.196276 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 431/878] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:05 2022] GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:46:06.217064 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-47156ec1-419a-4cbc-a1cc-93d0885a2854 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:06.218347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-47156ec1-419a-4cbc-a1cc-93d0885a2854 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: fb112b33-4a06-4ff4-832f-aa5d3310bf2a] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:06.225363 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-47156ec1-419a-4cbc-a1cc-93d0885a2854 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:06.225852 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-47156ec1-419a-4cbc-a1cc-93d0885a2854 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:06.226321 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-47156ec1-419a-4cbc-a1cc-93d0885a2854 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:06.227902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-47156ec1-419a-4cbc-a1cc-93d0885a2854 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:06.227902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-47156ec1-419a-4cbc-a1cc-93d0885a2854 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:06.228124 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-47156ec1-419a-4cbc-a1cc-93d0885a2854 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:06.288582 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-47156ec1-419a-4cbc-a1cc-93d0885a2854 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:06.297568 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-47156ec1-419a-4cbc-a1cc-93d0885a2854 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a" status: 200 len: 1143 microversion: 2.1 time: 0.084793 Aug 07 22:46:06.297771 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 448/879] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:06 2022] GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a => generated 1143 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:46:07.293985 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-0a3eb83c-56e5-4dcc-b169-54d8d85ec915 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcecb95f-ea42-47f3-b97d-bc3599b1a707"}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:46:07.296511 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-0a3eb83c-56e5-4dcc-b169-54d8d85ec915 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:07.304000 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0a3eb83c-56e5-4dcc-b169-54d8d85ec915 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:07.304577 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0a3eb83c-56e5-4dcc-b169-54d8d85ec915 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:07.305079 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0a3eb83c-56e5-4dcc-b169-54d8d85ec915 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:07.305883 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0a3eb83c-56e5-4dcc-b169-54d8d85ec915 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:07.306436 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0a3eb83c-56e5-4dcc-b169-54d8d85ec915 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:07.306928 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0a3eb83c-56e5-4dcc-b169-54d8d85ec915 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:07.317749 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a5213464-c7cf-4690-933a-f13d592c23f3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:07.318469 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a5213464-c7cf-4690-933a-f13d592c23f3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: fb112b33-4a06-4ff4-832f-aa5d3310bf2a] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:07.326079 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a5213464-c7cf-4690-933a-f13d592c23f3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:07.326847 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a5213464-c7cf-4690-933a-f13d592c23f3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:07.327491 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a5213464-c7cf-4690-933a-f13d592c23f3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:07.328315 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a5213464-c7cf-4690-933a-f13d592c23f3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:07.328827 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a5213464-c7cf-4690-933a-f13d592c23f3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:07.329482 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a5213464-c7cf-4690-933a-f13d592c23f3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:07.422933 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-a5213464-c7cf-4690-933a-f13d592c23f3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:07.431298 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a5213464-c7cf-4690-933a-f13d592c23f3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a" status: 200 len: 1199 microversion: 2.1 time: 0.116683 Aug 07 22:46:07.432527 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 449/880] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:07 2022] GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a => generated 1199 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:46:08.109176 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-0a3eb83c-56e5-4dcc-b169-54d8d85ec915 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "POST /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.816255 Aug 07 22:46:08.109176 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 432/881] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 22:46:07 2022] POST /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b/os-volume_attachments => generated 194 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:46:08.452731 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-90b2739b-3035-4c84-bf86-04c685efa10c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:08.453405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-90b2739b-3035-4c84-bf86-04c685efa10c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: fb112b33-4a06-4ff4-832f-aa5d3310bf2a] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:08.460604 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-90b2739b-3035-4c84-bf86-04c685efa10c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:08.462365 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-90b2739b-3035-4c84-bf86-04c685efa10c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:08.462800 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-90b2739b-3035-4c84-bf86-04c685efa10c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:08.463499 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-90b2739b-3035-4c84-bf86-04c685efa10c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:08.463946 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-90b2739b-3035-4c84-bf86-04c685efa10c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:08.464397 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-90b2739b-3035-4c84-bf86-04c685efa10c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:08.693189 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-90b2739b-3035-4c84-bf86-04c685efa10c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:08.705536 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-90b2739b-3035-4c84-bf86-04c685efa10c tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a" status: 200 len: 1277 microversion: 2.1 time: 0.256851 Aug 07 22:46:08.719555 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 450/882] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:08 2022] GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a => generated 1277 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:46:09.121188 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-39776d5d-80da-42eb-bec5-38faad1d1d1c req-d9bcbe4c-9d4d-4a6f-a6b4-5ce012487b53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb112b33-4a06-4ff4-832f-aa5d3310bf2a", "tag": "de5f33fd-64a7-43ad-a8dc-4a99b1fca15d"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:46:09.130939 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-39776d5d-80da-42eb-bec5-38faad1d1d1c req-d9bcbe4c-9d4d-4a6f-a6b4-5ce012487b53 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:09.131418 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-39776d5d-80da-42eb-bec5-38faad1d1d1c req-d9bcbe4c-9d4d-4a6f-a6b4-5ce012487b53 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:09.131850 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-39776d5d-80da-42eb-bec5-38faad1d1d1c req-d9bcbe4c-9d4d-4a6f-a6b4-5ce012487b53 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:09.143708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-39776d5d-80da-42eb-bec5-38faad1d1d1c req-d9bcbe4c-9d4d-4a6f-a6b4-5ce012487b53 service nova] Creating event network-changed:de5f33fd-64a7-43ad-a8dc-4a99b1fca15d for instance fb112b33-4a06-4ff4-832f-aa5d3310bf2a on hv-cinder-85032 Aug 07 22:46:09.148389 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-39776d5d-80da-42eb-bec5-38faad1d1d1c req-d9bcbe4c-9d4d-4a6f-a6b4-5ce012487b53 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032666 Aug 07 22:46:09.148991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 433/883] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:46:09.727990 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-6476b94e-b08f-465c-a787-2cf86d9c0f26 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:09.728627 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-6476b94e-b08f-465c-a787-2cf86d9c0f26 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: fb112b33-4a06-4ff4-832f-aa5d3310bf2a] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:09.735777 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6476b94e-b08f-465c-a787-2cf86d9c0f26 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:09.736297 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6476b94e-b08f-465c-a787-2cf86d9c0f26 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:09.736737 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6476b94e-b08f-465c-a787-2cf86d9c0f26 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:09.737428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6476b94e-b08f-465c-a787-2cf86d9c0f26 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:09.738070 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6476b94e-b08f-465c-a787-2cf86d9c0f26 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:09.738494 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6476b94e-b08f-465c-a787-2cf86d9c0f26 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:09.943937 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-6476b94e-b08f-465c-a787-2cf86d9c0f26 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:09.951982 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-6476b94e-b08f-465c-a787-2cf86d9c0f26 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a" status: 200 len: 1265 microversion: 2.1 time: 0.228593 Aug 07 22:46:09.952503 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 451/884] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:09 2022] GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:46:10.974205 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-aeae12ef-5380-4971-9fd4-87e8a7f289f6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:10.974897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-aeae12ef-5380-4971-9fd4-87e8a7f289f6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: fb112b33-4a06-4ff4-832f-aa5d3310bf2a] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:10.981703 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-aeae12ef-5380-4971-9fd4-87e8a7f289f6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:10.982177 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-aeae12ef-5380-4971-9fd4-87e8a7f289f6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:10.982606 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-aeae12ef-5380-4971-9fd4-87e8a7f289f6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:10.983326 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-aeae12ef-5380-4971-9fd4-87e8a7f289f6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:10.983775 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-aeae12ef-5380-4971-9fd4-87e8a7f289f6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:10.984226 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-aeae12ef-5380-4971-9fd4-87e8a7f289f6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:11.115071 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-aeae12ef-5380-4971-9fd4-87e8a7f289f6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:11.123210 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-aeae12ef-5380-4971-9fd4-87e8a7f289f6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a" status: 200 len: 1265 microversion: 2.1 time: 0.153731 Aug 07 22:46:11.123770 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 434/885] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:10 2022] GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:46:12.144459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-3972fc80-e4fc-401c-8f5b-b5756fc60f9f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:12.145065 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-3972fc80-e4fc-401c-8f5b-b5756fc60f9f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: fb112b33-4a06-4ff4-832f-aa5d3310bf2a] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:12.152234 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3972fc80-e4fc-401c-8f5b-b5756fc60f9f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:12.152712 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3972fc80-e4fc-401c-8f5b-b5756fc60f9f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:12.153147 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3972fc80-e4fc-401c-8f5b-b5756fc60f9f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:12.153828 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3972fc80-e4fc-401c-8f5b-b5756fc60f9f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:12.154279 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3972fc80-e4fc-401c-8f5b-b5756fc60f9f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:12.154702 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3972fc80-e4fc-401c-8f5b-b5756fc60f9f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:12.286656 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-3972fc80-e4fc-401c-8f5b-b5756fc60f9f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:12.294227 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-3972fc80-e4fc-401c-8f5b-b5756fc60f9f tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a" status: 200 len: 1265 microversion: 2.1 time: 0.153664 Aug 07 22:46:12.294791 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 452/886] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:12 2022] GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:46:13.314605 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-01030c06-bf7b-45fe-a40c-00f0ace1f08b tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:13.315236 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-01030c06-bf7b-45fe-a40c-00f0ace1f08b tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: fb112b33-4a06-4ff4-832f-aa5d3310bf2a] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:13.321782 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-01030c06-bf7b-45fe-a40c-00f0ace1f08b tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:13.322257 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-01030c06-bf7b-45fe-a40c-00f0ace1f08b tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:13.322684 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-01030c06-bf7b-45fe-a40c-00f0ace1f08b tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:13.323364 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-01030c06-bf7b-45fe-a40c-00f0ace1f08b tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:13.323810 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-01030c06-bf7b-45fe-a40c-00f0ace1f08b tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:13.324258 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-01030c06-bf7b-45fe-a40c-00f0ace1f08b tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:13.454269 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-01030c06-bf7b-45fe-a40c-00f0ace1f08b tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:13.462329 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-01030c06-bf7b-45fe-a40c-00f0ace1f08b tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a" status: 200 len: 1265 microversion: 2.1 time: 0.150972 Aug 07 22:46:13.465000 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 435/887] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:13 2022] GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:46:14.483536 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-6acad637-92bd-4772-af1a-2184366eceb7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:14.484252 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-6acad637-92bd-4772-af1a-2184366eceb7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: fb112b33-4a06-4ff4-832f-aa5d3310bf2a] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:14.490878 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6acad637-92bd-4772-af1a-2184366eceb7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:14.491356 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6acad637-92bd-4772-af1a-2184366eceb7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:14.491789 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6acad637-92bd-4772-af1a-2184366eceb7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:14.492499 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6acad637-92bd-4772-af1a-2184366eceb7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:14.493595 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6acad637-92bd-4772-af1a-2184366eceb7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:14.494018 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6acad637-92bd-4772-af1a-2184366eceb7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:14.629188 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-6acad637-92bd-4772-af1a-2184366eceb7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:14.637488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-6acad637-92bd-4772-af1a-2184366eceb7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a" status: 200 len: 1265 microversion: 2.1 time: 0.157715 Aug 07 22:46:14.638574 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 453/888] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:14 2022] GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:46:15.648188 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-e50ef64f-dd72-4557-b305-4a6fe94dfcf6 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:46:15.650796 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=2 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:46:15.655699 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e50ef64f-dd72-4557-b305-4a6fe94dfcf6 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:15.656211 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e50ef64f-dd72-4557-b305-4a6fe94dfcf6 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:15.656643 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e50ef64f-dd72-4557-b305-4a6fe94dfcf6 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:15.658425 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-98df3b0d-685e-42ef-addb-8f368da275d6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:15.659029 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-98df3b0d-685e-42ef-addb-8f368da275d6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: fb112b33-4a06-4ff4-832f-aa5d3310bf2a] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:15.660899 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=2 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:46:15.661555 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=6 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:46:15.667046 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-98df3b0d-685e-42ef-addb-8f368da275d6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:15.668730 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-98df3b0d-685e-42ef-addb-8f368da275d6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:15.668730 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-98df3b0d-685e-42ef-addb-8f368da275d6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:15.668730 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-98df3b0d-685e-42ef-addb-8f368da275d6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:15.669133 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-98df3b0d-685e-42ef-addb-8f368da275d6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:15.669565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-98df3b0d-685e-42ef-addb-8f368da275d6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:15.719500 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-e50ef64f-dd72-4557-b305-4a6fe94dfcf6 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Going to try to stop instance {{(pid=129965) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 07 22:46:15.803870 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-98df3b0d-685e-42ef-addb-8f368da275d6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:15.811442 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-98df3b0d-685e-42ef-addb-8f368da275d6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a" status: 200 len: 1265 microversion: 2.1 time: 0.156922 Aug 07 22:46:15.812003 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 454/889] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:15 2022] GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:46:15.907906 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-e50ef64f-dd72-4557-b305-4a6fe94dfcf6 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "POST /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b/action" status: 202 len: 0 microversion: 2.1 time: 0.263364 Aug 07 22:46:15.908625 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 436/890] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 22:46:15 2022] POST /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:46:15.916822 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-22c2c2d9-0829-4395-a0ff-f978ebf169fb tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:15.918923 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-22c2c2d9-0829-4395-a0ff-f978ebf169fb tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:15.923363 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-22c2c2d9-0829-4395-a0ff-f978ebf169fb tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:15.923842 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-22c2c2d9-0829-4395-a0ff-f978ebf169fb tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:15.924316 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-22c2c2d9-0829-4395-a0ff-f978ebf169fb tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:15.925061 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-22c2c2d9-0829-4395-a0ff-f978ebf169fb tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:15.925509 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-22c2c2d9-0829-4395-a0ff-f978ebf169fb tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:15.925936 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-22c2c2d9-0829-4395-a0ff-f978ebf169fb tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:16.061900 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-22c2c2d9-0829-4395-a0ff-f978ebf169fb tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:16.072294 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-22c2c2d9-0829-4395-a0ff-f978ebf169fb tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1719 microversion: 2.1 time: 0.159478 Aug 07 22:46:16.072861 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 455/891] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:15 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:46:16.833469 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-49ef862b-eafe-474d-92e0-3507518892cd tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:16.834171 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-49ef862b-eafe-474d-92e0-3507518892cd tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: fb112b33-4a06-4ff4-832f-aa5d3310bf2a] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:16.841033 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-49ef862b-eafe-474d-92e0-3507518892cd tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:16.841546 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-49ef862b-eafe-474d-92e0-3507518892cd tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:16.841988 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-49ef862b-eafe-474d-92e0-3507518892cd tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:16.842671 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-49ef862b-eafe-474d-92e0-3507518892cd tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:16.843124 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-49ef862b-eafe-474d-92e0-3507518892cd tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:16.843546 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-49ef862b-eafe-474d-92e0-3507518892cd tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:17.093518 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-bcd07fa5-6aca-464d-8f49-b8a6abefa3b1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:17.094049 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-bcd07fa5-6aca-464d-8f49-b8a6abefa3b1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:17.100357 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bcd07fa5-6aca-464d-8f49-b8a6abefa3b1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:17.100846 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bcd07fa5-6aca-464d-8f49-b8a6abefa3b1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:17.101289 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bcd07fa5-6aca-464d-8f49-b8a6abefa3b1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:17.101987 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bcd07fa5-6aca-464d-8f49-b8a6abefa3b1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:17.102558 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bcd07fa5-6aca-464d-8f49-b8a6abefa3b1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:17.103077 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bcd07fa5-6aca-464d-8f49-b8a6abefa3b1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:17.123655 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-49ef862b-eafe-474d-92e0-3507518892cd tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:17.131707 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-49ef862b-eafe-474d-92e0-3507518892cd tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a" status: 200 len: 1265 microversion: 2.1 time: 0.302817 Aug 07 22:46:17.132318 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 437/892] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:16 2022] GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a => generated 1265 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:46:17.380160 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-bcd07fa5-6aca-464d-8f49-b8a6abefa3b1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:17.388266 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-bcd07fa5-6aca-464d-8f49-b8a6abefa3b1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1719 microversion: 2.1 time: 0.298806 Aug 07 22:46:17.388821 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 456/893] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:17 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1719 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:46:18.153640 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ac1f7630-d222-4030-8580-dca78ef66fd3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:18.154275 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-ac1f7630-d222-4030-8580-dca78ef66fd3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: fb112b33-4a06-4ff4-832f-aa5d3310bf2a] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:18.160695 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ac1f7630-d222-4030-8580-dca78ef66fd3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:18.161172 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ac1f7630-d222-4030-8580-dca78ef66fd3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:18.161604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ac1f7630-d222-4030-8580-dca78ef66fd3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:18.162290 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ac1f7630-d222-4030-8580-dca78ef66fd3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:18.162740 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ac1f7630-d222-4030-8580-dca78ef66fd3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:18.163162 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ac1f7630-d222-4030-8580-dca78ef66fd3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:18.297828 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-ac1f7630-d222-4030-8580-dca78ef66fd3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:18.306011 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-ac1f7630-d222-4030-8580-dca78ef66fd3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a" status: 200 len: 1265 microversion: 2.1 time: 0.155679 Aug 07 22:46:18.307776 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 438/894] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:18 2022] GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:46:18.409594 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-7941f4b7-facb-4413-b14f-bd25a7d2e678 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:18.410208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-7941f4b7-facb-4413-b14f-bd25a7d2e678 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:18.417270 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7941f4b7-facb-4413-b14f-bd25a7d2e678 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:18.417759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7941f4b7-facb-4413-b14f-bd25a7d2e678 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:18.418197 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7941f4b7-facb-4413-b14f-bd25a7d2e678 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:18.418893 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7941f4b7-facb-4413-b14f-bd25a7d2e678 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:18.419345 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7941f4b7-facb-4413-b14f-bd25a7d2e678 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:18.419767 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7941f4b7-facb-4413-b14f-bd25a7d2e678 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:18.551802 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-7941f4b7-facb-4413-b14f-bd25a7d2e678 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:18.559773 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-7941f4b7-facb-4413-b14f-bd25a7d2e678 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1719 microversion: 2.1 time: 0.154038 Aug 07 22:46:18.560358 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 457/895] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:18 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:46:19.327081 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-71a8ee8b-df35-493a-8af0-ca78ef7a8c82 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:19.327716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-71a8ee8b-df35-493a-8af0-ca78ef7a8c82 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: fb112b33-4a06-4ff4-832f-aa5d3310bf2a] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:19.335877 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-71a8ee8b-df35-493a-8af0-ca78ef7a8c82 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:19.337164 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-71a8ee8b-df35-493a-8af0-ca78ef7a8c82 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:19.337731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-71a8ee8b-df35-493a-8af0-ca78ef7a8c82 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:19.338428 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-71a8ee8b-df35-493a-8af0-ca78ef7a8c82 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:19.338881 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-71a8ee8b-df35-493a-8af0-ca78ef7a8c82 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:19.339306 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-71a8ee8b-df35-493a-8af0-ca78ef7a8c82 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:19.472435 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-71a8ee8b-df35-493a-8af0-ca78ef7a8c82 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:19.480524 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-71a8ee8b-df35-493a-8af0-ca78ef7a8c82 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a" status: 200 len: 1265 microversion: 2.1 time: 0.157403 Aug 07 22:46:19.481085 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 439/896] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:19 2022] GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:46:19.581020 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-9c6a3e96-9a7b-461b-8043-52d84dc68b27 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:19.581574 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-9c6a3e96-9a7b-461b-8043-52d84dc68b27 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:19.588638 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9c6a3e96-9a7b-461b-8043-52d84dc68b27 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:19.589113 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9c6a3e96-9a7b-461b-8043-52d84dc68b27 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:19.589544 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9c6a3e96-9a7b-461b-8043-52d84dc68b27 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:19.590219 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9c6a3e96-9a7b-461b-8043-52d84dc68b27 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:19.590667 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9c6a3e96-9a7b-461b-8043-52d84dc68b27 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:19.591085 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9c6a3e96-9a7b-461b-8043-52d84dc68b27 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:19.717541 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-9c6a3e96-9a7b-461b-8043-52d84dc68b27 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:19.725407 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-9c6a3e96-9a7b-461b-8043-52d84dc68b27 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1719 microversion: 2.1 time: 0.148263 Aug 07 22:46:19.725956 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 458/897] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:19 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1719 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:46:20.501443 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-014d07ac-b855-4411-bb37-4859b2399af3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:20.502822 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-014d07ac-b855-4411-bb37-4859b2399af3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: fb112b33-4a06-4ff4-832f-aa5d3310bf2a] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:20.509464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-014d07ac-b855-4411-bb37-4859b2399af3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:20.509947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-014d07ac-b855-4411-bb37-4859b2399af3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:20.510384 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-014d07ac-b855-4411-bb37-4859b2399af3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:20.511084 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-014d07ac-b855-4411-bb37-4859b2399af3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:20.511534 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-014d07ac-b855-4411-bb37-4859b2399af3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:20.511953 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-014d07ac-b855-4411-bb37-4859b2399af3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:20.545503 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-26145d7c-ef69-4809-8d7d-7e6491b030a7 req-a163f711-9f40-4ca7-9f1c-ed175fbba62a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb112b33-4a06-4ff4-832f-aa5d3310bf2a", "name": "network-vif-plugged", "status": "completed", "tag": "de5f33fd-64a7-43ad-a8dc-4a99b1fca15d"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:46:20.556176 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-26145d7c-ef69-4809-8d7d-7e6491b030a7 req-a163f711-9f40-4ca7-9f1c-ed175fbba62a service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:20.556742 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-26145d7c-ef69-4809-8d7d-7e6491b030a7 req-a163f711-9f40-4ca7-9f1c-ed175fbba62a service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:20.557434 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-26145d7c-ef69-4809-8d7d-7e6491b030a7 req-a163f711-9f40-4ca7-9f1c-ed175fbba62a service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:20.568374 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-26145d7c-ef69-4809-8d7d-7e6491b030a7 req-a163f711-9f40-4ca7-9f1c-ed175fbba62a service nova] Creating event network-vif-plugged:de5f33fd-64a7-43ad-a8dc-4a99b1fca15d for instance fb112b33-4a06-4ff4-832f-aa5d3310bf2a on hv-cinder-85032 Aug 07 22:46:20.574018 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-26145d7c-ef69-4809-8d7d-7e6491b030a7 req-a163f711-9f40-4ca7-9f1c-ed175fbba62a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032328 Aug 07 22:46:20.574593 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 459/898] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:46:20.650787 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-014d07ac-b855-4411-bb37-4859b2399af3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:20.658418 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-014d07ac-b855-4411-bb37-4859b2399af3 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a" status: 200 len: 1265 microversion: 2.1 time: 0.161141 Aug 07 22:46:20.661275 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 440/899] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:20 2022] GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:46:20.747864 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-ecf0f389-3337-4bed-b85b-6810b3ee2d19 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:20.748539 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-ecf0f389-3337-4bed-b85b-6810b3ee2d19 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:20.754662 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ecf0f389-3337-4bed-b85b-6810b3ee2d19 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:20.758925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ecf0f389-3337-4bed-b85b-6810b3ee2d19 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:20.758925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ecf0f389-3337-4bed-b85b-6810b3ee2d19 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:20.758925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ecf0f389-3337-4bed-b85b-6810b3ee2d19 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:20.758925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ecf0f389-3337-4bed-b85b-6810b3ee2d19 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:20.759305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ecf0f389-3337-4bed-b85b-6810b3ee2d19 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:20.891367 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-ecf0f389-3337-4bed-b85b-6810b3ee2d19 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:20.899498 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-ecf0f389-3337-4bed-b85b-6810b3ee2d19 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1719 microversion: 2.1 time: 0.156943 Aug 07 22:46:20.906178 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 460/900] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:20 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:46:21.678634 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-467000e9-d454-4b59-8ebf-6927eeffc157 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:21.679244 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-467000e9-d454-4b59-8ebf-6927eeffc157 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: fb112b33-4a06-4ff4-832f-aa5d3310bf2a] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:21.686336 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-467000e9-d454-4b59-8ebf-6927eeffc157 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:21.686930 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-467000e9-d454-4b59-8ebf-6927eeffc157 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:21.687406 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-467000e9-d454-4b59-8ebf-6927eeffc157 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:21.688127 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-467000e9-d454-4b59-8ebf-6927eeffc157 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:21.688583 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-467000e9-d454-4b59-8ebf-6927eeffc157 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:21.689035 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-467000e9-d454-4b59-8ebf-6927eeffc157 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:21.822435 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-467000e9-d454-4b59-8ebf-6927eeffc157 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:21.829863 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-467000e9-d454-4b59-8ebf-6927eeffc157 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a" status: 200 len: 1265 microversion: 2.1 time: 0.155061 Aug 07 22:46:21.830425 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 441/901] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:21 2022] GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:46:21.921514 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-7c403328-dccb-423a-96e7-1de829749f81 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:21.922038 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-7c403328-dccb-423a-96e7-1de829749f81 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:21.928368 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7c403328-dccb-423a-96e7-1de829749f81 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:21.928848 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7c403328-dccb-423a-96e7-1de829749f81 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:21.929281 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7c403328-dccb-423a-96e7-1de829749f81 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:21.929961 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7c403328-dccb-423a-96e7-1de829749f81 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:21.930417 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7c403328-dccb-423a-96e7-1de829749f81 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:21.930837 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7c403328-dccb-423a-96e7-1de829749f81 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:22.061160 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-7c403328-dccb-423a-96e7-1de829749f81 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:22.069010 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-7c403328-dccb-423a-96e7-1de829749f81 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1719 microversion: 2.1 time: 0.151402 Aug 07 22:46:22.069571 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 461/902] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:21 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:46:22.850572 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-3afe1190-adbb-4b1a-9cb5-9cfaff220ffc tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:22.851181 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-3afe1190-adbb-4b1a-9cb5-9cfaff220ffc tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: fb112b33-4a06-4ff4-832f-aa5d3310bf2a] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:22.857717 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3afe1190-adbb-4b1a-9cb5-9cfaff220ffc tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:22.858194 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3afe1190-adbb-4b1a-9cb5-9cfaff220ffc tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:22.858625 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3afe1190-adbb-4b1a-9cb5-9cfaff220ffc tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:22.859392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3afe1190-adbb-4b1a-9cb5-9cfaff220ffc tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:22.859854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3afe1190-adbb-4b1a-9cb5-9cfaff220ffc tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:22.860317 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3afe1190-adbb-4b1a-9cb5-9cfaff220ffc tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:23.012103 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-3afe1190-adbb-4b1a-9cb5-9cfaff220ffc tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:23.020041 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-3afe1190-adbb-4b1a-9cb5-9cfaff220ffc tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a" status: 200 len: 1452 microversion: 2.1 time: 0.173369 Aug 07 22:46:23.020610 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 442/903] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:22 2022] GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a => generated 1452 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:46:23.040879 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-2ea773fa-804e-40c2-8fde-530f2063641e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:23.042230 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-2ea773fa-804e-40c2-8fde-530f2063641e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: fb112b33-4a06-4ff4-832f-aa5d3310bf2a] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:23.048803 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2ea773fa-804e-40c2-8fde-530f2063641e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:23.049316 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2ea773fa-804e-40c2-8fde-530f2063641e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:23.049756 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2ea773fa-804e-40c2-8fde-530f2063641e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:23.050450 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2ea773fa-804e-40c2-8fde-530f2063641e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:23.050904 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2ea773fa-804e-40c2-8fde-530f2063641e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:23.051327 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2ea773fa-804e-40c2-8fde-530f2063641e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:23.089984 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-4fb9e8e9-4144-491a-8a11-452d64e8caf4 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:23.090596 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-4fb9e8e9-4144-491a-8a11-452d64e8caf4 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:23.096592 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4fb9e8e9-4144-491a-8a11-452d64e8caf4 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:23.097075 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4fb9e8e9-4144-491a-8a11-452d64e8caf4 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:23.097520 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4fb9e8e9-4144-491a-8a11-452d64e8caf4 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:23.098219 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4fb9e8e9-4144-491a-8a11-452d64e8caf4 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:23.098677 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4fb9e8e9-4144-491a-8a11-452d64e8caf4 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:23.099100 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4fb9e8e9-4144-491a-8a11-452d64e8caf4 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:23.233263 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-2ea773fa-804e-40c2-8fde-530f2063641e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:23.240802 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-2ea773fa-804e-40c2-8fde-530f2063641e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a" status: 200 len: 1452 microversion: 2.1 time: 0.204296 Aug 07 22:46:23.241367 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 462/904] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:23 2022] GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a => generated 1452 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:46:23.263881 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-4fb9e8e9-4144-491a-8a11-452d64e8caf4 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:23.271938 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-4fb9e8e9-4144-491a-8a11-452d64e8caf4 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1719 microversion: 2.1 time: 0.186398 Aug 07 22:46:23.272547 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 443/905] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:23 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1719 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:46:24.293961 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-5f8b45d2-0eb6-434e-a250-eec0da6a385b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:24.294565 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-5f8b45d2-0eb6-434e-a250-eec0da6a385b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:24.301716 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5f8b45d2-0eb6-434e-a250-eec0da6a385b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:24.302194 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5f8b45d2-0eb6-434e-a250-eec0da6a385b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:24.302627 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5f8b45d2-0eb6-434e-a250-eec0da6a385b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:24.303317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5f8b45d2-0eb6-434e-a250-eec0da6a385b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:24.303817 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5f8b45d2-0eb6-434e-a250-eec0da6a385b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:24.304523 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-5f8b45d2-0eb6-434e-a250-eec0da6a385b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:24.443807 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-5f8b45d2-0eb6-434e-a250-eec0da6a385b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:24.451834 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-5f8b45d2-0eb6-434e-a250-eec0da6a385b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1719 microversion: 2.1 time: 0.162541 Aug 07 22:46:24.452423 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 463/906] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:24 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:46:25.109264 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-bb82f9bf-33a7-49ac-b326-6eb4a9b62092 req-27e6243b-6b15-433f-8d9c-7b83e6d46a99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb112b33-4a06-4ff4-832f-aa5d3310bf2a", "tag": "de5f33fd-64a7-43ad-a8dc-4a99b1fca15d"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:46:25.118941 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-bb82f9bf-33a7-49ac-b326-6eb4a9b62092 req-27e6243b-6b15-433f-8d9c-7b83e6d46a99 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:25.119409 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-bb82f9bf-33a7-49ac-b326-6eb4a9b62092 req-27e6243b-6b15-433f-8d9c-7b83e6d46a99 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:25.119843 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-bb82f9bf-33a7-49ac-b326-6eb4a9b62092 req-27e6243b-6b15-433f-8d9c-7b83e6d46a99 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:25.131012 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-bb82f9bf-33a7-49ac-b326-6eb4a9b62092 req-27e6243b-6b15-433f-8d9c-7b83e6d46a99 service nova] Creating event network-changed:de5f33fd-64a7-43ad-a8dc-4a99b1fca15d for instance fb112b33-4a06-4ff4-832f-aa5d3310bf2a on hv-cinder-85032 Aug 07 22:46:25.136604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-bb82f9bf-33a7-49ac-b326-6eb4a9b62092 req-27e6243b-6b15-433f-8d9c-7b83e6d46a99 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030951 Aug 07 22:46:25.137453 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 444/907] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:46:25.474132 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-60973011-2142-4dcb-8b93-9b8e6eaabe9e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:25.474754 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-60973011-2142-4dcb-8b93-9b8e6eaabe9e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:25.481484 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-60973011-2142-4dcb-8b93-9b8e6eaabe9e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:25.481973 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-60973011-2142-4dcb-8b93-9b8e6eaabe9e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:25.482403 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-60973011-2142-4dcb-8b93-9b8e6eaabe9e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:25.483095 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-60973011-2142-4dcb-8b93-9b8e6eaabe9e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:25.483550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-60973011-2142-4dcb-8b93-9b8e6eaabe9e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:25.483967 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-60973011-2142-4dcb-8b93-9b8e6eaabe9e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:25.703070 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-60973011-2142-4dcb-8b93-9b8e6eaabe9e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:25.706917 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=100 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:46:25.713152 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-60973011-2142-4dcb-8b93-9b8e6eaabe9e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1719 microversion: 2.1 time: 0.242445 Aug 07 22:46:25.717874 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 464/908] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:25 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1719 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:46:26.736373 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-0bcf8ab7-88c7-4dd7-a7f2-8e23c714d7a5 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:26.737325 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-0bcf8ab7-88c7-4dd7-a7f2-8e23c714d7a5 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:26.744153 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0bcf8ab7-88c7-4dd7-a7f2-8e23c714d7a5 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:26.744635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0bcf8ab7-88c7-4dd7-a7f2-8e23c714d7a5 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:26.745067 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0bcf8ab7-88c7-4dd7-a7f2-8e23c714d7a5 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:26.745753 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0bcf8ab7-88c7-4dd7-a7f2-8e23c714d7a5 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:26.746198 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0bcf8ab7-88c7-4dd7-a7f2-8e23c714d7a5 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:26.746618 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0bcf8ab7-88c7-4dd7-a7f2-8e23c714d7a5 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:26.882974 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-0bcf8ab7-88c7-4dd7-a7f2-8e23c714d7a5 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:26.891868 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-0bcf8ab7-88c7-4dd7-a7f2-8e23c714d7a5 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1719 microversion: 2.1 time: 0.160809 Aug 07 22:46:26.892469 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 445/909] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:26 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:46:27.913490 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-1188c441-f680-43b4-8013-272071179e8d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:27.914093 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-1188c441-f680-43b4-8013-272071179e8d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:27.921165 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1188c441-f680-43b4-8013-272071179e8d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:27.921637 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1188c441-f680-43b4-8013-272071179e8d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:27.922066 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1188c441-f680-43b4-8013-272071179e8d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:27.922745 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1188c441-f680-43b4-8013-272071179e8d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:27.923192 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1188c441-f680-43b4-8013-272071179e8d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:27.923608 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1188c441-f680-43b4-8013-272071179e8d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:28.052405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-1188c441-f680-43b4-8013-272071179e8d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:28.061278 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-1188c441-f680-43b4-8013-272071179e8d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1696 microversion: 2.1 time: 0.151663 Aug 07 22:46:28.061863 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 465/910] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:27 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1696 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:46:28.081780 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-b08eb8e9-dd18-4fb7-b93e-43b3d4712769 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:46:28.124427 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b08eb8e9-dd18-4fb7-b93e-43b3d4712769 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:28.124914 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b08eb8e9-dd18-4fb7-b93e-43b3d4712769 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:28.125357 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b08eb8e9-dd18-4fb7-b93e-43b3d4712769 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:28.146861 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-b08eb8e9-dd18-4fb7-b93e-43b3d4712769 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Going to try to start instance {{(pid=129965) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 07 22:46:28.151355 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:46:28.312826 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-b08eb8e9-dd18-4fb7-b93e-43b3d4712769 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "POST /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b/action" status: 202 len: 0 microversion: 2.1 time: 0.234740 Aug 07 22:46:28.313433 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 446/911] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 22:46:28 2022] POST /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:46:28.322250 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-2d42377d-4da1-4654-827a-72ca1cce17d9 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:28.322917 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-2d42377d-4da1-4654-827a-72ca1cce17d9 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:28.328809 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2d42377d-4da1-4654-827a-72ca1cce17d9 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:28.334198 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2d42377d-4da1-4654-827a-72ca1cce17d9 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:28.334198 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2d42377d-4da1-4654-827a-72ca1cce17d9 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:28.334198 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2d42377d-4da1-4654-827a-72ca1cce17d9 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:28.334198 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2d42377d-4da1-4654-827a-72ca1cce17d9 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:28.334630 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2d42377d-4da1-4654-827a-72ca1cce17d9 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:28.464732 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-2d42377d-4da1-4654-827a-72ca1cce17d9 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:28.472897 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-2d42377d-4da1-4654-827a-72ca1cce17d9 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1705 microversion: 2.1 time: 0.155083 Aug 07 22:46:28.473461 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 466/912] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:28 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1705 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:46:29.495937 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-80c22b12-8ce9-4261-9e06-c8b9a1565b74 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:29.496669 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-80c22b12-8ce9-4261-9e06-c8b9a1565b74 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:29.503300 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-80c22b12-8ce9-4261-9e06-c8b9a1565b74 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:29.503782 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-80c22b12-8ce9-4261-9e06-c8b9a1565b74 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:29.504270 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-80c22b12-8ce9-4261-9e06-c8b9a1565b74 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:29.504968 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-80c22b12-8ce9-4261-9e06-c8b9a1565b74 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:29.505430 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-80c22b12-8ce9-4261-9e06-c8b9a1565b74 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:29.505858 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-80c22b12-8ce9-4261-9e06-c8b9a1565b74 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:29.636678 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-80c22b12-8ce9-4261-9e06-c8b9a1565b74 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:29.644808 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-80c22b12-8ce9-4261-9e06-c8b9a1565b74 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1705 microversion: 2.1 time: 0.154468 Aug 07 22:46:29.645368 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 447/913] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:29 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1705 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:46:30.664923 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-49faf155-16a8-4b50-a27d-92cb6666c00d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:46:30.665628 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-49faf155-16a8-4b50-a27d-92cb6666c00d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:46:30.672052 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-49faf155-16a8-4b50-a27d-92cb6666c00d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:30.672530 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-49faf155-16a8-4b50-a27d-92cb6666c00d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:30.672963 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-49faf155-16a8-4b50-a27d-92cb6666c00d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:30.673640 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-49faf155-16a8-4b50-a27d-92cb6666c00d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:46:30.674087 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-49faf155-16a8-4b50-a27d-92cb6666c00d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:46:30.674506 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-49faf155-16a8-4b50-a27d-92cb6666c00d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:46:30.802522 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-49faf155-16a8-4b50-a27d-92cb6666c00d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:46:30.811236 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-49faf155-16a8-4b50-a27d-92cb6666c00d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1709 microversion: 2.1 time: 0.150218 Aug 07 22:46:30.811796 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 467/914] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:46:30 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1709 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:47:04.299915 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-466c9dd1-c801-478c-a373-fb20dc85a28e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:47:04.300536 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-466c9dd1-c801-478c-a373-fb20dc85a28e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:47:04.303060 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=38 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:47:04.303428 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:47:04.308081 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-466c9dd1-c801-478c-a373-fb20dc85a28e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:04.308589 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-466c9dd1-c801-478c-a373-fb20dc85a28e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:04.309005 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-466c9dd1-c801-478c-a373-fb20dc85a28e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:04.309696 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-466c9dd1-c801-478c-a373-fb20dc85a28e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:04.310147 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-466c9dd1-c801-478c-a373-fb20dc85a28e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:04.310591 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-466c9dd1-c801-478c-a373-fb20dc85a28e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:04.391236 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.objects.instance [None req-466c9dd1-c801-478c-a373-fb20dc85a28e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lazy-loading 'services' on Instance uuid 3243af5d-9b7f-4839-9877-cf6edb147c8b {{(pid=129965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:47:04.597344 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-466c9dd1-c801-478c-a373-fb20dc85a28e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b/os-volume_attachments/fcecb95f-ea42-47f3-b97d-bc3599b1a707" status: 202 len: 0 microversion: 2.1 time: 0.301835 Aug 07 22:47:04.597853 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 448/915] 10.222.0.30 () {58 vars in 1416 bytes} [Sun Aug 7 22:47:04 2022] DELETE /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b/os-volume_attachments/fcecb95f-ea42-47f3-b97d-bc3599b1a707 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:47:05.715267 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-55741c9d-6be2-4c20-8f9b-829e38c5cd54 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:47:05.718545 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:47:05.724119 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=18 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:47:05.724119 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-55741c9d-6be2-4c20-8f9b-829e38c5cd54 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:05.724119 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-55741c9d-6be2-4c20-8f9b-829e38c5cd54 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:05.724119 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-55741c9d-6be2-4c20-8f9b-829e38c5cd54 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:05.785867 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-55741c9d-6be2-4c20-8f9b-829e38c5cd54 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Going to try to stop instance {{(pid=129964) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 07 22:47:05.989748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-55741c9d-6be2-4c20-8f9b-829e38c5cd54 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "POST /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b/action" status: 202 len: 0 microversion: 2.1 time: 0.278027 Aug 07 22:47:05.990349 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 468/916] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 22:47:05 2022] POST /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:47:06.000005 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-42e83e87-df3d-4989-887c-86943dde591c tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:47:06.000881 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-42e83e87-df3d-4989-887c-86943dde591c tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:47:06.007041 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-42e83e87-df3d-4989-887c-86943dde591c tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:06.007521 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-42e83e87-df3d-4989-887c-86943dde591c tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:06.007952 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-42e83e87-df3d-4989-887c-86943dde591c tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:06.008664 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-42e83e87-df3d-4989-887c-86943dde591c tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:06.009114 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-42e83e87-df3d-4989-887c-86943dde591c tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:06.009537 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-42e83e87-df3d-4989-887c-86943dde591c tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:06.143057 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-42e83e87-df3d-4989-887c-86943dde591c tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:47:06.150559 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-42e83e87-df3d-4989-887c-86943dde591c tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1673 microversion: 2.1 time: 0.155429 Aug 07 22:47:06.152451 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 449/917] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:47:05 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:47:07.176809 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b78c7590-cdfe-44fd-aa41-3a8dcfd2d26f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:47:07.177496 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-b78c7590-cdfe-44fd-aa41-3a8dcfd2d26f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:47:07.183504 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b78c7590-cdfe-44fd-aa41-3a8dcfd2d26f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:07.187449 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b78c7590-cdfe-44fd-aa41-3a8dcfd2d26f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:07.187449 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b78c7590-cdfe-44fd-aa41-3a8dcfd2d26f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:07.187449 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b78c7590-cdfe-44fd-aa41-3a8dcfd2d26f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:07.187449 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b78c7590-cdfe-44fd-aa41-3a8dcfd2d26f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:07.187871 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b78c7590-cdfe-44fd-aa41-3a8dcfd2d26f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:07.314725 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-b78c7590-cdfe-44fd-aa41-3a8dcfd2d26f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:47:07.322026 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-b78c7590-cdfe-44fd-aa41-3a8dcfd2d26f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1673 microversion: 2.1 time: 0.150554 Aug 07 22:47:07.322585 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 469/918] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:47:07 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:47:08.342613 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-0ad25e77-8a96-4632-bc43-d8b759b4430e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:47:08.343286 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-0ad25e77-8a96-4632-bc43-d8b759b4430e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:47:08.349784 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0ad25e77-8a96-4632-bc43-d8b759b4430e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:08.350259 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0ad25e77-8a96-4632-bc43-d8b759b4430e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:08.350687 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0ad25e77-8a96-4632-bc43-d8b759b4430e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:08.351366 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0ad25e77-8a96-4632-bc43-d8b759b4430e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:08.351814 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0ad25e77-8a96-4632-bc43-d8b759b4430e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:08.352264 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0ad25e77-8a96-4632-bc43-d8b759b4430e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:08.486474 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-0ad25e77-8a96-4632-bc43-d8b759b4430e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:47:08.494021 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-0ad25e77-8a96-4632-bc43-d8b759b4430e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1673 microversion: 2.1 time: 0.155319 Aug 07 22:47:08.494583 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 450/919] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:47:08 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:47:09.516307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-480bcc52-cef6-4964-9d67-3ede10a83c33 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:47:09.517083 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-480bcc52-cef6-4964-9d67-3ede10a83c33 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:47:09.523390 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-480bcc52-cef6-4964-9d67-3ede10a83c33 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:09.523873 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-480bcc52-cef6-4964-9d67-3ede10a83c33 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:09.524343 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-480bcc52-cef6-4964-9d67-3ede10a83c33 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:09.525057 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-480bcc52-cef6-4964-9d67-3ede10a83c33 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:09.525511 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-480bcc52-cef6-4964-9d67-3ede10a83c33 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:09.525935 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-480bcc52-cef6-4964-9d67-3ede10a83c33 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:09.653596 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-480bcc52-cef6-4964-9d67-3ede10a83c33 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:47:09.661325 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-480bcc52-cef6-4964-9d67-3ede10a83c33 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1673 microversion: 2.1 time: 0.149850 Aug 07 22:47:09.665904 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 470/920] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:47:09 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:47:10.683756 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-2604cae1-81f7-46d1-b940-0ca57b312e22 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:47:10.684390 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-2604cae1-81f7-46d1-b940-0ca57b312e22 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:47:10.691683 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2604cae1-81f7-46d1-b940-0ca57b312e22 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:10.692207 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2604cae1-81f7-46d1-b940-0ca57b312e22 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:10.692645 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2604cae1-81f7-46d1-b940-0ca57b312e22 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:10.693336 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2604cae1-81f7-46d1-b940-0ca57b312e22 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:10.693793 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2604cae1-81f7-46d1-b940-0ca57b312e22 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:10.694219 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-2604cae1-81f7-46d1-b940-0ca57b312e22 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:10.825054 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-2604cae1-81f7-46d1-b940-0ca57b312e22 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:47:10.833266 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-2604cae1-81f7-46d1-b940-0ca57b312e22 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1673 microversion: 2.1 time: 0.153354 Aug 07 22:47:10.833820 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 451/921] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:47:10 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:47:11.853937 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-dd158d89-d79c-48d9-9842-9c1f67005a49 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:47:11.854549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-dd158d89-d79c-48d9-9842-9c1f67005a49 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:47:11.861777 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dd158d89-d79c-48d9-9842-9c1f67005a49 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:11.862266 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dd158d89-d79c-48d9-9842-9c1f67005a49 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:11.862737 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dd158d89-d79c-48d9-9842-9c1f67005a49 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:11.863428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dd158d89-d79c-48d9-9842-9c1f67005a49 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:11.863888 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dd158d89-d79c-48d9-9842-9c1f67005a49 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:11.864340 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-dd158d89-d79c-48d9-9842-9c1f67005a49 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:11.991604 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-dd158d89-d79c-48d9-9842-9c1f67005a49 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:47:11.999077 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-dd158d89-d79c-48d9-9842-9c1f67005a49 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1673 microversion: 2.1 time: 0.149011 Aug 07 22:47:11.999639 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 471/922] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:47:11 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:47:13.020783 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-46d60f6a-cfc6-47ea-95ee-d88988a7efbe tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:47:13.021387 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-46d60f6a-cfc6-47ea-95ee-d88988a7efbe tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:47:13.027716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-46d60f6a-cfc6-47ea-95ee-d88988a7efbe tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:13.028226 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-46d60f6a-cfc6-47ea-95ee-d88988a7efbe tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:13.028659 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-46d60f6a-cfc6-47ea-95ee-d88988a7efbe tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:13.029338 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-46d60f6a-cfc6-47ea-95ee-d88988a7efbe tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:13.029787 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-46d60f6a-cfc6-47ea-95ee-d88988a7efbe tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:13.030206 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-46d60f6a-cfc6-47ea-95ee-d88988a7efbe tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:13.156181 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-46d60f6a-cfc6-47ea-95ee-d88988a7efbe tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:47:13.164296 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-46d60f6a-cfc6-47ea-95ee-d88988a7efbe tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1673 microversion: 2.1 time: 0.147400 Aug 07 22:47:13.164854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 452/923] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:47:13 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:47:14.184987 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-651a72b8-b319-41b1-9417-8b3b2738ca1b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:47:14.185591 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-651a72b8-b319-41b1-9417-8b3b2738ca1b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:47:14.192684 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-651a72b8-b319-41b1-9417-8b3b2738ca1b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:14.193098 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-651a72b8-b319-41b1-9417-8b3b2738ca1b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:14.193527 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-651a72b8-b319-41b1-9417-8b3b2738ca1b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:14.194201 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-651a72b8-b319-41b1-9417-8b3b2738ca1b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:14.194647 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-651a72b8-b319-41b1-9417-8b3b2738ca1b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:14.195063 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-651a72b8-b319-41b1-9417-8b3b2738ca1b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:14.333692 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-651a72b8-b319-41b1-9417-8b3b2738ca1b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:47:14.333692 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-651a72b8-b319-41b1-9417-8b3b2738ca1b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1673 microversion: 2.1 time: 0.152120 Aug 07 22:47:14.334067 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 472/924] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:47:14 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:47:15.354783 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-8b6178e0-036f-4a46-a616-b54e4a7a9e40 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:47:15.355428 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-8b6178e0-036f-4a46-a616-b54e4a7a9e40 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:47:15.362055 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8b6178e0-036f-4a46-a616-b54e4a7a9e40 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:15.362537 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8b6178e0-036f-4a46-a616-b54e4a7a9e40 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:15.362970 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8b6178e0-036f-4a46-a616-b54e4a7a9e40 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:15.363655 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8b6178e0-036f-4a46-a616-b54e4a7a9e40 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:15.364206 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8b6178e0-036f-4a46-a616-b54e4a7a9e40 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:15.364632 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8b6178e0-036f-4a46-a616-b54e4a7a9e40 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:15.493986 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8b6178e0-036f-4a46-a616-b54e4a7a9e40 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:47:15.499408 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-8b6178e0-036f-4a46-a616-b54e4a7a9e40 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1673 microversion: 2.1 time: 0.148553 Aug 07 22:47:15.499969 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 453/925] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:47:15 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:47:16.521278 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-ae4fe1c2-b3ca-4fa2-bfba-80d298674c79 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:47:16.521896 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-ae4fe1c2-b3ca-4fa2-bfba-80d298674c79 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:47:16.528401 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ae4fe1c2-b3ca-4fa2-bfba-80d298674c79 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:16.528876 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ae4fe1c2-b3ca-4fa2-bfba-80d298674c79 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:16.529306 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ae4fe1c2-b3ca-4fa2-bfba-80d298674c79 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:16.529986 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ae4fe1c2-b3ca-4fa2-bfba-80d298674c79 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:16.530429 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ae4fe1c2-b3ca-4fa2-bfba-80d298674c79 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:16.530848 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-ae4fe1c2-b3ca-4fa2-bfba-80d298674c79 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:16.663105 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-ae4fe1c2-b3ca-4fa2-bfba-80d298674c79 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:47:16.670679 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-ae4fe1c2-b3ca-4fa2-bfba-80d298674c79 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1673 microversion: 2.1 time: 0.153793 Aug 07 22:47:16.671246 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 473/926] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:47:16 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:47:17.692363 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-e8d80b8d-8e43-4056-8c29-d493c089e1d8 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:47:17.692975 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-e8d80b8d-8e43-4056-8c29-d493c089e1d8 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:47:17.699455 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e8d80b8d-8e43-4056-8c29-d493c089e1d8 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:17.699935 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e8d80b8d-8e43-4056-8c29-d493c089e1d8 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:17.700403 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e8d80b8d-8e43-4056-8c29-d493c089e1d8 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:17.701112 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e8d80b8d-8e43-4056-8c29-d493c089e1d8 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:17.701567 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e8d80b8d-8e43-4056-8c29-d493c089e1d8 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:17.701991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-e8d80b8d-8e43-4056-8c29-d493c089e1d8 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:17.828800 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-e8d80b8d-8e43-4056-8c29-d493c089e1d8 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:47:17.836680 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-e8d80b8d-8e43-4056-8c29-d493c089e1d8 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1650 microversion: 2.1 time: 0.148570 Aug 07 22:47:17.837238 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 454/927] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:47:17 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1650 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:47:17.857380 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f9f94c57-3e3a-4e86-9c1f-c1b4fb625072 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:47:17.863970 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f9f94c57-3e3a-4e86-9c1f-c1b4fb625072 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:17.864482 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f9f94c57-3e3a-4e86-9c1f-c1b4fb625072 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:17.864920 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f9f94c57-3e3a-4e86-9c1f-c1b4fb625072 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:17.888419 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f9f94c57-3e3a-4e86-9c1f-c1b4fb625072 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Going to try to start instance {{(pid=129964) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 07 22:47:18.055418 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f9f94c57-3e3a-4e86-9c1f-c1b4fb625072 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "POST /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b/action" status: 202 len: 0 microversion: 2.1 time: 0.201596 Aug 07 22:47:18.056216 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 474/928] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 22:47:17 2022] POST /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:47:18.064329 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-938ed535-98cd-41ef-a4ce-690949d00494 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:47:18.064943 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-938ed535-98cd-41ef-a4ce-690949d00494 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:47:18.070750 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-938ed535-98cd-41ef-a4ce-690949d00494 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:18.073754 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-938ed535-98cd-41ef-a4ce-690949d00494 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:18.073754 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-938ed535-98cd-41ef-a4ce-690949d00494 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:18.073754 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-938ed535-98cd-41ef-a4ce-690949d00494 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:18.073754 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-938ed535-98cd-41ef-a4ce-690949d00494 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:18.074222 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-938ed535-98cd-41ef-a4ce-690949d00494 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:18.209559 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-938ed535-98cd-41ef-a4ce-690949d00494 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:47:18.217552 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-938ed535-98cd-41ef-a4ce-690949d00494 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1659 microversion: 2.1 time: 0.157099 Aug 07 22:47:18.218132 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 455/929] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:47:18 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1659 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:47:19.240364 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-981c930f-3d0c-4c7b-a1fe-2c38fcdedf2e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:47:19.241059 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-981c930f-3d0c-4c7b-a1fe-2c38fcdedf2e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:47:19.247106 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-981c930f-3d0c-4c7b-a1fe-2c38fcdedf2e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:19.247584 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-981c930f-3d0c-4c7b-a1fe-2c38fcdedf2e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:19.248030 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-981c930f-3d0c-4c7b-a1fe-2c38fcdedf2e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:19.248713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-981c930f-3d0c-4c7b-a1fe-2c38fcdedf2e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:19.249166 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-981c930f-3d0c-4c7b-a1fe-2c38fcdedf2e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:19.249583 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-981c930f-3d0c-4c7b-a1fe-2c38fcdedf2e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:19.381356 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-981c930f-3d0c-4c7b-a1fe-2c38fcdedf2e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:47:19.389320 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-981c930f-3d0c-4c7b-a1fe-2c38fcdedf2e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1659 microversion: 2.1 time: 0.154213 Aug 07 22:47:19.389814 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 475/930] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:47:19 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1659 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:47:20.410600 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7bf741a8-164b-46d7-b6a9-c6161142b683 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:47:20.411214 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-7bf741a8-164b-46d7-b6a9-c6161142b683 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:47:20.417646 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7bf741a8-164b-46d7-b6a9-c6161142b683 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:20.418130 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7bf741a8-164b-46d7-b6a9-c6161142b683 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:20.418569 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7bf741a8-164b-46d7-b6a9-c6161142b683 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:20.419256 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7bf741a8-164b-46d7-b6a9-c6161142b683 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:20.419711 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7bf741a8-164b-46d7-b6a9-c6161142b683 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:20.420165 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7bf741a8-164b-46d7-b6a9-c6161142b683 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:20.731996 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7bf741a8-164b-46d7-b6a9-c6161142b683 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:47:20.740005 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-7bf741a8-164b-46d7-b6a9-c6161142b683 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1663 microversion: 2.1 time: 0.333587 Aug 07 22:47:20.740785 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 456/931] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:47:20 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1663 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:47:35.197846 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 22:47:35.198538 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Sun Aug 7 22:47:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 22:47:53.312982 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-7ede3b05-8276-4ecf-9d31-6b2b3b5e5e72 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:47:53.315121 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-7ede3b05-8276-4ecf-9d31-6b2b3b5e5e72 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:47:53.317331 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_api:SELECT=16 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:47:53.318122 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:47:53.322563 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7ede3b05-8276-4ecf-9d31-6b2b3b5e5e72 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:53.323040 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7ede3b05-8276-4ecf-9d31-6b2b3b5e5e72 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:53.323472 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7ede3b05-8276-4ecf-9d31-6b2b3b5e5e72 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:53.324191 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7ede3b05-8276-4ecf-9d31-6b2b3b5e5e72 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:53.324640 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7ede3b05-8276-4ecf-9d31-6b2b3b5e5e72 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:53.325074 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7ede3b05-8276-4ecf-9d31-6b2b3b5e5e72 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:53.353539 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-7ede3b05-8276-4ecf-9d31-6b2b3b5e5e72 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045228 Aug 07 22:47:53.354085 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 476/932] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 22:47:53 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 22:47:53.416796 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-8e8fefc5-69b1-4129-bb76-8ed6ac30072f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:47:53.417380 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-8e8fefc5-69b1-4129-bb76-8ed6ac30072f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:47:53.419568 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=18 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:47:53.420250 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=1 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:47:53.425556 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8e8fefc5-69b1-4129-bb76-8ed6ac30072f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:53.426039 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8e8fefc5-69b1-4129-bb76-8ed6ac30072f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:53.426501 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8e8fefc5-69b1-4129-bb76-8ed6ac30072f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:53.427198 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8e8fefc5-69b1-4129-bb76-8ed6ac30072f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:53.427657 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8e8fefc5-69b1-4129-bb76-8ed6ac30072f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:53.428113 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8e8fefc5-69b1-4129-bb76-8ed6ac30072f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:53.453201 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-8e8fefc5-69b1-4129-bb76-8ed6ac30072f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Going to try to terminate instance {{(pid=129965) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 22:47:53.709148 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-8e8fefc5-69b1-4129-bb76-8ed6ac30072f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 204 len: 0 microversion: 2.1 time: 0.295907 Aug 07 22:47:53.709810 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 457/933] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:47:53 2022] DELETE /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 22:47:53.719135 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a3db3243-41a8-4766-a078-5769b21213ee tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:47:53.719765 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a3db3243-41a8-4766-a078-5769b21213ee tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:47:53.726743 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a3db3243-41a8-4766-a078-5769b21213ee tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:53.727219 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a3db3243-41a8-4766-a078-5769b21213ee tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:53.727652 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a3db3243-41a8-4766-a078-5769b21213ee tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:53.728363 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a3db3243-41a8-4766-a078-5769b21213ee tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:53.729537 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a3db3243-41a8-4766-a078-5769b21213ee tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:53.729991 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a3db3243-41a8-4766-a078-5769b21213ee tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:53.916369 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-a3db3243-41a8-4766-a078-5769b21213ee tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:47:53.924317 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a3db3243-41a8-4766-a078-5769b21213ee tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1669 microversion: 2.1 time: 0.209942 Aug 07 22:47:53.924883 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 477/934] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:47:53 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1669 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:47:54.946576 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7d31aae1-41eb-47b2-9aee-515063fed68a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:47:54.947278 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-7d31aae1-41eb-47b2-9aee-515063fed68a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:47:54.954628 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7d31aae1-41eb-47b2-9aee-515063fed68a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:54.955105 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7d31aae1-41eb-47b2-9aee-515063fed68a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:54.955542 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7d31aae1-41eb-47b2-9aee-515063fed68a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:54.956260 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7d31aae1-41eb-47b2-9aee-515063fed68a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:54.956722 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7d31aae1-41eb-47b2-9aee-515063fed68a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:54.957147 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7d31aae1-41eb-47b2-9aee-515063fed68a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:55.084501 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7d31aae1-41eb-47b2-9aee-515063fed68a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:47:55.091916 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-7d31aae1-41eb-47b2-9aee-515063fed68a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1669 microversion: 2.1 time: 0.149610 Aug 07 22:47:55.092521 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 458/935] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:47:54 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1669 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:47:56.113956 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-cf4aad7f-6a08-4209-b3d3-53c3f42c0306 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:47:56.114588 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-cf4aad7f-6a08-4209-b3d3-53c3f42c0306 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:47:56.121040 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cf4aad7f-6a08-4209-b3d3-53c3f42c0306 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:56.121523 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cf4aad7f-6a08-4209-b3d3-53c3f42c0306 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:56.121953 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cf4aad7f-6a08-4209-b3d3-53c3f42c0306 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:56.122636 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cf4aad7f-6a08-4209-b3d3-53c3f42c0306 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:56.123085 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cf4aad7f-6a08-4209-b3d3-53c3f42c0306 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:56.123504 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-cf4aad7f-6a08-4209-b3d3-53c3f42c0306 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:56.605631 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-cf4aad7f-6a08-4209-b3d3-53c3f42c0306 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:47:56.614390 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-cf4aad7f-6a08-4209-b3d3-53c3f42c0306 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1669 microversion: 2.1 time: 0.504178 Aug 07 22:47:56.615052 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 478/936] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:47:56 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1669 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:47:57.226068 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-f223bc32-d267-4077-ae63-9d26a943e3dd req-29c68cda-a280-4567-83bb-f6723e7b64e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3243af5d-9b7f-4839-9877-cf6edb147c8b", "name": "network-vif-deleted", "tag": "d4da0a83-078e-472f-880d-48ba7a21c476"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:47:57.237522 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-f223bc32-d267-4077-ae63-9d26a943e3dd req-29c68cda-a280-4567-83bb-f6723e7b64e8 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:57.238339 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-f223bc32-d267-4077-ae63-9d26a943e3dd req-29c68cda-a280-4567-83bb-f6723e7b64e8 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:57.239333 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-f223bc32-d267-4077-ae63-9d26a943e3dd req-29c68cda-a280-4567-83bb-f6723e7b64e8 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:57.255454 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-f223bc32-d267-4077-ae63-9d26a943e3dd req-29c68cda-a280-4567-83bb-f6723e7b64e8 service nova] Creating event network-vif-deleted:d4da0a83-078e-472f-880d-48ba7a21c476 for instance 3243af5d-9b7f-4839-9877-cf6edb147c8b on hv-cinder-85032 Aug 07 22:47:57.264061 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-f223bc32-d267-4077-ae63-9d26a943e3dd req-29c68cda-a280-4567-83bb-f6723e7b64e8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107286 Aug 07 22:47:57.265686 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 459/937] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:47:57.637892 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-4075c729-5979-4573-bc61-7e7f141f6e8a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:47:57.638720 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-4075c729-5979-4573-bc61-7e7f141f6e8a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:47:57.646096 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4075c729-5979-4573-bc61-7e7f141f6e8a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:57.646584 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4075c729-5979-4573-bc61-7e7f141f6e8a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:57.647018 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4075c729-5979-4573-bc61-7e7f141f6e8a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:57.647740 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4075c729-5979-4573-bc61-7e7f141f6e8a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:57.648220 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4075c729-5979-4573-bc61-7e7f141f6e8a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:57.648671 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4075c729-5979-4573-bc61-7e7f141f6e8a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:57.680861 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4075c729-5979-4573-bc61-7e7f141f6e8a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:57.681350 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4075c729-5979-4573-bc61-7e7f141f6e8a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:57.681784 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4075c729-5979-4573-bc61-7e7f141f6e8a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:57.682227 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.objects.instance [None req-4075c729-5979-4573-bc61-7e7f141f6e8a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lazy-loading 'fault' on Instance uuid 3243af5d-9b7f-4839-9877-cf6edb147c8b {{(pid=129964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:47:57.726133 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-4075c729-5979-4573-bc61-7e7f141f6e8a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:47:57.733553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-4075c729-5979-4573-bc61-7e7f141f6e8a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 200 len: 1325 microversion: 2.1 time: 0.099753 Aug 07 22:47:57.734828 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 479/938] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:47:57 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 1325 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:47:58.756962 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-a117ec1f-dd2e-4825-8bf3-aacaf2131b63 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:47:58.757656 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-a117ec1f-dd2e-4825-8bf3-aacaf2131b63 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:47:58.763987 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a117ec1f-dd2e-4825-8bf3-aacaf2131b63 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:58.764496 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a117ec1f-dd2e-4825-8bf3-aacaf2131b63 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:58.764927 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a117ec1f-dd2e-4825-8bf3-aacaf2131b63 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:58.766227 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a117ec1f-dd2e-4825-8bf3-aacaf2131b63 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:47:58.766675 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a117ec1f-dd2e-4825-8bf3-aacaf2131b63 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:47:58.767097 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a117ec1f-dd2e-4825-8bf3-aacaf2131b63 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:47:58.779930 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.wsgi [None req-a117ec1f-dd2e-4825-8bf3-aacaf2131b63 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] HTTP exception thrown: Instance 3243af5d-9b7f-4839-9877-cf6edb147c8b could not be found. Aug 07 22:47:58.781612 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-a117ec1f-dd2e-4825-8bf3-aacaf2131b63 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Request method failure captured: Aug 07 22:47:58.781612 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: request: GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b HTTP/1.1 Aug 07 22:47:58.781612 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept: application/json Aug 07 22:47:58.781612 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept-Encoding: identity Aug 07 22:47:58.781612 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Connection: close Aug 07 22:47:58.781612 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Length: 0 Aug 07 22:47:58.781612 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Type: application/json Aug 07 22:47:58.781612 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Host: 10.222.0.30 Aug 07 22:47:58.781612 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Openstack-System-Scope: None Aug 07 22:47:58.781612 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: User-Agent: python-urllib3/1.26.11 Aug 07 22:47:58.781612 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Auth-Token: gAAAAABi8EB1dUYsBPce-qUgdyzouxxiPwXLhFmQ622zM7d_DY6IAOwVwk2k1UVunNiTbS8jXHlj-b6Re9GcDYS6W8mOqCGd4WfZoUCThkWNdhfhobgHXXSVTwgd5KyDzd9MGoY4ljapEHDIYgKK4L0eG097UTU5PC-61wsSMlwlp5AHNclHUhk Aug 07 22:47:58.781612 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Id: None Aug 07 22:47:58.781612 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Name: None Aug 07 22:47:58.781612 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Identity-Status: Confirmed Aug 07 22:47:58.781612 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Is-Admin-Project: True Aug 07 22:47:58.781612 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Id: default Aug 07 22:47:58.781612 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Name: Default Aug 07 22:47:58.781612 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Id: dd66028a147f42e1aa29abd7c22d00f9 Aug 07 22:47:58.781612 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Name: tempest-AttachVolumeTestJSON-209546250 Aug 07 22:47:58.781612 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Role: reader,member Aug 07 22:47:58.781612 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Roles: reader,member Aug 07 22:47:58.783224 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dd66028a147f42e1aa29abd7c22d00f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dd66028a147f42e1aa29abd7c22d00f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dd66028a147f42e1aa29abd7c22d00f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dd66028a147f42e1aa29abd7c22d00f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:47:58.783224 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant: tempest-AttachVolumeTestJSON-209546250 Aug 07 22:47:58.783224 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Id: dd66028a147f42e1aa29abd7c22d00f9 Aug 07 22:47:58.783224 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Name: tempest-AttachVolumeTestJSON-209546250 Aug 07 22:47:58.783224 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User: tempest-AttachVolumeTestJSON-209546250-project Aug 07 22:47:58.783224 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Id: default Aug 07 22:47:58.783224 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Name: Default Aug 07 22:47:58.783224 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Id: 990056333138468c99292c3f00605e6c Aug 07 22:47:58.783224 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Name: tempest-AttachVolumeTestJSON-209546250-project Aug 07 22:47:58.783224 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: method: > Aug 07 22:47:58.783224 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: exception: Instance 3243af5d-9b7f-4839-9877-cf6edb147c8b could not be found. Aug 07 22:47:58.783224 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: action_args: {'id': '3243af5d-9b7f-4839-9877-cf6edb147c8b'} Aug 07 22:47:58.784298 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:47:58.784298 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:47:58.784298 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:47:58.784298 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:47:58.784298 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:47:58.784298 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:47:58.784298 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:47:58.784298 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:47:58.784298 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:47:58.784298 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:47:58.784298 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3243af5d-9b7f-4839-9877-cf6edb147c8b could not be found. Aug 07 22:47:58.784298 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:47:58.784298 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:47:58.784298 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:47:58.784298 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:47:58.784298 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:47:58.784298 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:47:58.784298 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:47:58.784298 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:47:58.784298 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:47:58.786143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:47:58.786143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:47:58.786143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:47:58.786143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:47:58.786143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:47:58.786143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:47:58.786143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:47:58.786143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3243af5d-9b7f-4839-9877-cf6edb147c8b could not be found. Aug 07 22:47:58.786143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:47:58.786143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:47:58.786143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:47:58.786143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:47:58.786143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:47:58.786143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:47:58.786143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:47:58.786143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:47:58.786143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3243af5d-9b7f-4839-9877-cf6edb147c8b could not be found. Aug 07 22:47:58.786143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:47:58.787519 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-a117ec1f-dd2e-4825-8bf3-aacaf2131b63 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Returning 404 to user: Instance 3243af5d-9b7f-4839-9877-cf6edb147c8b could not be found. {{(pid=129965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:47:58.787519 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-a117ec1f-dd2e-4825-8bf3-aacaf2131b63 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 404 len: 111 microversion: 2.1 time: 0.030881 Aug 07 22:47:58.787519 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 460/939] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:47:58 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:47:58.791944 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-90be1b1b-34f0-42a0-b4fc-a32a8006c8cd tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '.version_select at 0x7fc09faff280>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:47:58.875452 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-90be1b1b-34f0-42a0-b4fc-a32a8006c8cd tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-12344583" status: 202 len: 0 microversion: 2.1 time: 0.086672 Aug 07 22:47:58.876032 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 480/940] 10.222.0.30 () {58 vars in 1215 bytes} [Sun Aug 7 22:47:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-12344583 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:47:59.605818 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-071078e0-3f0e-4a91-b564-fc1acdc9cbdd tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Action: 'create', calling method: .version_select at 0x7fc0ac595c10>, body: {"keypair": {"name": "tempest-keypair-1127876051", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVKVohagadmwB52CC5Yi1mp2DUWDaODfc/+HO1PaN+pMJiRbd5/vvGFV4venDrgVyTgctZ3h9w1P9VU/RWFhXoevv+YyO8M5Tfkjh194gGtDbtJ0+ZEo6h12mT+yAS6Wg=="}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:47:59.622915 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-071078e0-3f0e-4a91-b564-fc1acdc9cbdd tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Getting quotas for project dd66028a147f42e1aa29abd7c22d00f9. Resources: {'key_pairs'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:47:59.626878 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-071078e0-3f0e-4a91-b564-fc1acdc9cbdd tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Getting quotas for user 990056333138468c99292c3f00605e6c and project dd66028a147f42e1aa29abd7c22d00f9. Resources: {'key_pairs'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:47:59.700861 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-071078e0-3f0e-4a91-b564-fc1acdc9cbdd tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.098907 Aug 07 22:47:59.701447 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 461/941] 10.222.0.30 () {60 vars in 1159 bytes} [Sun Aug 7 22:47:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:48:01.906219 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-d5dbfe42-580f-4f1d-b38d-dc52b11695de tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-152659806", "imageRef": "91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d4e4604-9d4f-40f0-a6e7-b7d1c70da8ee"}], "security_groups": [{"name": "tempest-securitygroup--192070862"}], "key_name": "tempest-keypair-1127876051", "user_data": "}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:48:02.009742 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.network.neutron [None req-d5dbfe42-580f-4f1d-b38d-dc52b11695de tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] validate_networks() for [('8d4e4604-9d4f-40f0-a6e7-b7d1c70da8ee', None, None, None, None, None)] {{(pid=129964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 22:48:02.383271 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-d5dbfe42-580f-4f1d-b38d-dc52b11695de tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Flavor limits 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 22:48:02.383696 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-d5dbfe42-580f-4f1d-b38d-dc52b11695de tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Image limits 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 22:48:02.384214 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-d5dbfe42-580f-4f1d-b38d-dc52b11695de tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Flavor pref 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 22:48:02.384621 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-d5dbfe42-580f-4f1d-b38d-dc52b11695de tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Image pref 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 22:48:02.385032 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-d5dbfe42-580f-4f1d-b38d-dc52b11695de tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 22:48:02.394480 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d5dbfe42-580f-4f1d-b38d-dc52b11695de tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:02.394954 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d5dbfe42-580f-4f1d-b38d-dc52b11695de tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:02.395413 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d5dbfe42-580f-4f1d-b38d-dc52b11695de tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:02.396169 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d5dbfe42-580f-4f1d-b38d-dc52b11695de tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:02.396621 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d5dbfe42-580f-4f1d-b38d-dc52b11695de tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:02.397047 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d5dbfe42-580f-4f1d-b38d-dc52b11695de tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:02.414736 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-d5dbfe42-580f-4f1d-b38d-dc52b11695de tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Getting quotas for project dd66028a147f42e1aa29abd7c22d00f9. Resources: {'cores', 'instances', 'ram'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:48:02.418815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-d5dbfe42-580f-4f1d-b38d-dc52b11695de tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Getting quotas for user 990056333138468c99292c3f00605e6c and project dd66028a147f42e1aa29abd7c22d00f9. Resources: {'cores', 'instances', 'ram'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:48:02.429965 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-d5dbfe42-580f-4f1d-b38d-dc52b11695de tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Going to run 1 instances... {{(pid=129964) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 22:48:02.432252 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-d5dbfe42-580f-4f1d-b38d-dc52b11695de tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 22:48:02.550614 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-d5dbfe42-580f-4f1d-b38d-dc52b11695de tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.649677 Aug 07 22:48:02.551258 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 481/942] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 22:48:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 22:48:02.562615 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-908c93d4-eb74-4a0d-938c-e2064471cf59 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:02.563314 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-908c93d4-eb74-4a0d-938c-e2064471cf59 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:02.625512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-908c93d4-eb74-4a0d-938c-e2064471cf59 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:48:02.632235 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-908c93d4-eb74-4a0d-938c-e2064471cf59 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6" status: 200 len: 1237 microversion: 2.1 time: 0.073996 Aug 07 22:48:02.632728 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 462/943] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:48:02 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6 => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:48:03.653361 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-f783dceb-6596-449c-b9d4-2f26f1076275 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:03.653974 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-f783dceb-6596-449c-b9d4-2f26f1076275 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:03.661119 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f783dceb-6596-449c-b9d4-2f26f1076275 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:03.661579 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f783dceb-6596-449c-b9d4-2f26f1076275 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:03.664760 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f783dceb-6596-449c-b9d4-2f26f1076275 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:03.664760 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f783dceb-6596-449c-b9d4-2f26f1076275 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:03.664760 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f783dceb-6596-449c-b9d4-2f26f1076275 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:03.664760 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-f783dceb-6596-449c-b9d4-2f26f1076275 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:03.730384 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-f783dceb-6596-449c-b9d4-2f26f1076275 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:48:03.738794 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-f783dceb-6596-449c-b9d4-2f26f1076275 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6" status: 200 len: 1241 microversion: 2.1 time: 0.089378 Aug 07 22:48:03.739354 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 482/944] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:48:03 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:48:04.761033 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-060cef5f-b418-4816-9c67-e53f901055fb tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:04.761649 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-060cef5f-b418-4816-9c67-e53f901055fb tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:04.772581 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-060cef5f-b418-4816-9c67-e53f901055fb tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:04.773321 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-060cef5f-b418-4816-9c67-e53f901055fb tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:04.773586 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-060cef5f-b418-4816-9c67-e53f901055fb tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:04.774279 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-060cef5f-b418-4816-9c67-e53f901055fb tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:04.774735 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-060cef5f-b418-4816-9c67-e53f901055fb tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:04.775162 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-060cef5f-b418-4816-9c67-e53f901055fb tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:04.864591 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-04643d3a-8dd9-4dd7-943b-e6d04da037f9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:04.867134 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-04643d3a-8dd9-4dd7-943b-e6d04da037f9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: fb112b33-4a06-4ff4-832f-aa5d3310bf2a] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:04.872761 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-060cef5f-b418-4816-9c67-e53f901055fb tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:48:04.877400 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-04643d3a-8dd9-4dd7-943b-e6d04da037f9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:04.878153 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-04643d3a-8dd9-4dd7-943b-e6d04da037f9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:04.878753 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-04643d3a-8dd9-4dd7-943b-e6d04da037f9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:04.879746 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-04643d3a-8dd9-4dd7-943b-e6d04da037f9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:04.880376 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-04643d3a-8dd9-4dd7-943b-e6d04da037f9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:04.881608 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-04643d3a-8dd9-4dd7-943b-e6d04da037f9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:04.886983 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-060cef5f-b418-4816-9c67-e53f901055fb tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6" status: 200 len: 1307 microversion: 2.1 time: 0.131254 Aug 07 22:48:04.891106 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 463/945] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:48:04 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6 => generated 1307 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:48:04.897068 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-d20d02a6-2f90-4057-9d97-df6f97ecb758 req-65a24bce-bd40-42ab-ab19-8a1b8c228f2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb112b33-4a06-4ff4-832f-aa5d3310bf2a", "tag": "de5f33fd-64a7-43ad-a8dc-4a99b1fca15d"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:48:04.925789 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-d20d02a6-2f90-4057-9d97-df6f97ecb758 req-65a24bce-bd40-42ab-ab19-8a1b8c228f2f service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:04.925789 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-d20d02a6-2f90-4057-9d97-df6f97ecb758 req-65a24bce-bd40-42ab-ab19-8a1b8c228f2f service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:04.925789 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-d20d02a6-2f90-4057-9d97-df6f97ecb758 req-65a24bce-bd40-42ab-ab19-8a1b8c228f2f service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:04.939562 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-04643d3a-8dd9-4dd7-943b-e6d04da037f9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: fb112b33-4a06-4ff4-832f-aa5d3310bf2a] Going to try to terminate instance {{(pid=129964) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 22:48:04.940121 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-d20d02a6-2f90-4057-9d97-df6f97ecb758 req-65a24bce-bd40-42ab-ab19-8a1b8c228f2f service nova] Creating event network-changed:de5f33fd-64a7-43ad-a8dc-4a99b1fca15d for instance fb112b33-4a06-4ff4-832f-aa5d3310bf2a on hv-cinder-85032 Aug 07 22:48:04.947036 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-d20d02a6-2f90-4057-9d97-df6f97ecb758 req-65a24bce-bd40-42ab-ab19-8a1b8c228f2f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053735 Aug 07 22:48:04.947638 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 464/946] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:48:05.257182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-04643d3a-8dd9-4dd7-943b-e6d04da037f9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a" status: 204 len: 0 microversion: 2.1 time: 0.395575 Aug 07 22:48:05.259225 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 483/947] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:48:04 2022] DELETE /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 22:48:05.268676 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-6732fc3c-f028-4087-b71d-82fe6c0d82ff tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:05.269372 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-6732fc3c-f028-4087-b71d-82fe6c0d82ff tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: fb112b33-4a06-4ff4-832f-aa5d3310bf2a] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:05.286286 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6732fc3c-f028-4087-b71d-82fe6c0d82ff tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:05.287116 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6732fc3c-f028-4087-b71d-82fe6c0d82ff tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:05.287852 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6732fc3c-f028-4087-b71d-82fe6c0d82ff tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:05.288755 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6732fc3c-f028-4087-b71d-82fe6c0d82ff tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:05.289422 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6732fc3c-f028-4087-b71d-82fe6c0d82ff tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:05.290033 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6732fc3c-f028-4087-b71d-82fe6c0d82ff tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:05.481854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-6732fc3c-f028-4087-b71d-82fe6c0d82ff tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:48:05.490640 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-6732fc3c-f028-4087-b71d-82fe6c0d82ff tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a" status: 200 len: 1576 microversion: 2.1 time: 0.226563 Aug 07 22:48:05.491315 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 465/948] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:48:05 2022] GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a => generated 1576 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:48:05.913854 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-c82bcef4-8232-4972-983f-bdfa7b6dd134 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:05.914556 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-c82bcef4-8232-4972-983f-bdfa7b6dd134 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:05.921724 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c82bcef4-8232-4972-983f-bdfa7b6dd134 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:05.922210 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c82bcef4-8232-4972-983f-bdfa7b6dd134 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:05.922738 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c82bcef4-8232-4972-983f-bdfa7b6dd134 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:05.923434 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c82bcef4-8232-4972-983f-bdfa7b6dd134 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:05.923887 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c82bcef4-8232-4972-983f-bdfa7b6dd134 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:05.924335 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c82bcef4-8232-4972-983f-bdfa7b6dd134 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:06.056542 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-c82bcef4-8232-4972-983f-bdfa7b6dd134 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:48:06.064798 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-c82bcef4-8232-4972-983f-bdfa7b6dd134 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6" status: 200 len: 1362 microversion: 2.1 time: 0.155200 Aug 07 22:48:06.065362 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 484/949] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:48:05 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:48:06.524043 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-12966a92-bc71-44e4-9221-e43553fa45d9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:06.524782 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-12966a92-bc71-44e4-9221-e43553fa45d9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: fb112b33-4a06-4ff4-832f-aa5d3310bf2a] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:06.531241 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-12966a92-bc71-44e4-9221-e43553fa45d9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:06.532080 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-12966a92-bc71-44e4-9221-e43553fa45d9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:06.532592 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-12966a92-bc71-44e4-9221-e43553fa45d9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:06.533367 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-12966a92-bc71-44e4-9221-e43553fa45d9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:06.533888 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-12966a92-bc71-44e4-9221-e43553fa45d9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:06.534372 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-12966a92-bc71-44e4-9221-e43553fa45d9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:06.779131 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-12966a92-bc71-44e4-9221-e43553fa45d9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:48:06.788058 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-12966a92-bc71-44e4-9221-e43553fa45d9 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a" status: 200 len: 1576 microversion: 2.1 time: 0.267905 Aug 07 22:48:06.788771 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 466/950] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:48:06 2022] GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a => generated 1576 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:48:07.086581 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-2d768fe9-c729-4192-86cb-c41754958b61 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:07.087365 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-2d768fe9-c729-4192-86cb-c41754958b61 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:07.094494 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2d768fe9-c729-4192-86cb-c41754958b61 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:07.095068 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2d768fe9-c729-4192-86cb-c41754958b61 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:07.095588 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2d768fe9-c729-4192-86cb-c41754958b61 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:07.096402 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2d768fe9-c729-4192-86cb-c41754958b61 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:07.096854 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2d768fe9-c729-4192-86cb-c41754958b61 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:07.097285 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2d768fe9-c729-4192-86cb-c41754958b61 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:07.308290 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-2d768fe9-c729-4192-86cb-c41754958b61 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:48:07.316699 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-2d768fe9-c729-4192-86cb-c41754958b61 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6" status: 200 len: 1362 microversion: 2.1 time: 0.234120 Aug 07 22:48:07.317324 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 485/951] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:48:07 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:48:07.495955 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-3520c909-7b43-42d6-8775-0d5be2ae75df req-2ecdf14d-22e4-4c87-b9dd-f33f051c448b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b093247c-d4ae-470e-b717-2e665540e9d6", "tag": "f26c3b4a-e4d6-4e1c-8a50-597ab9ad0659"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:48:07.505874 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-3520c909-7b43-42d6-8775-0d5be2ae75df req-2ecdf14d-22e4-4c87-b9dd-f33f051c448b service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:07.508515 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-3520c909-7b43-42d6-8775-0d5be2ae75df req-2ecdf14d-22e4-4c87-b9dd-f33f051c448b service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:07.511149 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-3520c909-7b43-42d6-8775-0d5be2ae75df req-2ecdf14d-22e4-4c87-b9dd-f33f051c448b service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:07.522075 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-3520c909-7b43-42d6-8775-0d5be2ae75df req-2ecdf14d-22e4-4c87-b9dd-f33f051c448b service nova] Creating event network-changed:f26c3b4a-e4d6-4e1c-8a50-597ab9ad0659 for instance b093247c-d4ae-470e-b717-2e665540e9d6 on hv-cinder-85032 Aug 07 22:48:07.526910 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-3520c909-7b43-42d6-8775-0d5be2ae75df req-2ecdf14d-22e4-4c87-b9dd-f33f051c448b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035053 Aug 07 22:48:07.528481 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 467/952] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:48:07.612507 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-034e6658-4172-42e0-a4eb-a792b4067e6a req-4281c5e4-93c8-456e-b5f9-2af2883a6121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb112b33-4a06-4ff4-832f-aa5d3310bf2a", "name": "network-vif-deleted", "tag": "de5f33fd-64a7-43ad-a8dc-4a99b1fca15d"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:48:07.621284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-034e6658-4172-42e0-a4eb-a792b4067e6a req-4281c5e4-93c8-456e-b5f9-2af2883a6121 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:07.621760 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-034e6658-4172-42e0-a4eb-a792b4067e6a req-4281c5e4-93c8-456e-b5f9-2af2883a6121 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:07.622182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-034e6658-4172-42e0-a4eb-a792b4067e6a req-4281c5e4-93c8-456e-b5f9-2af2883a6121 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:07.634045 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-034e6658-4172-42e0-a4eb-a792b4067e6a req-4281c5e4-93c8-456e-b5f9-2af2883a6121 service nova] Creating event network-vif-deleted:de5f33fd-64a7-43ad-a8dc-4a99b1fca15d for instance fb112b33-4a06-4ff4-832f-aa5d3310bf2a on hv-cinder-85032 Aug 07 22:48:07.639264 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-034e6658-4172-42e0-a4eb-a792b4067e6a req-4281c5e4-93c8-456e-b5f9-2af2883a6121 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037118 Aug 07 22:48:07.639861 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 486/953] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:48:07.811037 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-bb6d6a67-554f-4ae4-88c6-acf767bc2938 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:07.811741 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-bb6d6a67-554f-4ae4-88c6-acf767bc2938 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: fb112b33-4a06-4ff4-832f-aa5d3310bf2a] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:07.818749 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bb6d6a67-554f-4ae4-88c6-acf767bc2938 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:07.819263 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bb6d6a67-554f-4ae4-88c6-acf767bc2938 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:07.819708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bb6d6a67-554f-4ae4-88c6-acf767bc2938 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:07.820518 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bb6d6a67-554f-4ae4-88c6-acf767bc2938 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:07.821000 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bb6d6a67-554f-4ae4-88c6-acf767bc2938 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:07.821399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-bb6d6a67-554f-4ae4-88c6-acf767bc2938 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:08.181666 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-bb6d6a67-554f-4ae4-88c6-acf767bc2938 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:48:08.189471 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-bb6d6a67-554f-4ae4-88c6-acf767bc2938 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a" status: 200 len: 1224 microversion: 2.1 time: 0.383034 Aug 07 22:48:08.190040 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 468/954] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:48:07 2022] GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a => generated 1224 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:48:08.339244 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-4f97332b-50a9-4af9-9d46-175999b0aa8a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:08.340127 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-4f97332b-50a9-4af9-9d46-175999b0aa8a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:08.347267 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4f97332b-50a9-4af9-9d46-175999b0aa8a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:08.347773 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4f97332b-50a9-4af9-9d46-175999b0aa8a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:08.348277 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4f97332b-50a9-4af9-9d46-175999b0aa8a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:08.348971 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4f97332b-50a9-4af9-9d46-175999b0aa8a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:08.349422 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4f97332b-50a9-4af9-9d46-175999b0aa8a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:08.349840 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4f97332b-50a9-4af9-9d46-175999b0aa8a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:08.490429 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-4f97332b-50a9-4af9-9d46-175999b0aa8a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:48:08.497794 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-4f97332b-50a9-4af9-9d46-175999b0aa8a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6" status: 200 len: 1362 microversion: 2.1 time: 0.163447 Aug 07 22:48:08.498362 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 487/955] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:48:08 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:48:09.210320 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-446ed175-f6a9-4672-8bc5-5516ab93cb13 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:09.210927 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-446ed175-f6a9-4672-8bc5-5516ab93cb13 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: fb112b33-4a06-4ff4-832f-aa5d3310bf2a] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:09.217400 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-446ed175-f6a9-4672-8bc5-5516ab93cb13 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:09.217882 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-446ed175-f6a9-4672-8bc5-5516ab93cb13 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:09.218314 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-446ed175-f6a9-4672-8bc5-5516ab93cb13 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:09.218997 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-446ed175-f6a9-4672-8bc5-5516ab93cb13 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:09.219447 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-446ed175-f6a9-4672-8bc5-5516ab93cb13 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:09.219869 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-446ed175-f6a9-4672-8bc5-5516ab93cb13 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:09.233798 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.wsgi [None req-446ed175-f6a9-4672-8bc5-5516ab93cb13 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] HTTP exception thrown: Instance fb112b33-4a06-4ff4-832f-aa5d3310bf2a could not be found. Aug 07 22:48:09.235464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-446ed175-f6a9-4672-8bc5-5516ab93cb13 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Request method failure captured: Aug 07 22:48:09.235464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: request: GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a HTTP/1.1 Aug 07 22:48:09.235464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept: application/json Aug 07 22:48:09.235464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept-Encoding: identity Aug 07 22:48:09.235464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Connection: close Aug 07 22:48:09.235464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Length: 0 Aug 07 22:48:09.235464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Type: application/json Aug 07 22:48:09.235464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Host: 10.222.0.30 Aug 07 22:48:09.235464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Openstack-System-Scope: None Aug 07 22:48:09.235464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: User-Agent: python-urllib3/1.26.11 Aug 07 22:48:09.235464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Auth-Token: gAAAAABi8D887V40Peke5jC_QXWsggzAOgLpyxdi_CaERou7vZSymX0hnbt8UkNtFBgypCBm03NmM2Hk6XjJTocxVbaKwu7bOFYcL67tzHVphf3he2hSGQMyJttsp-GmBJmhjsx8BV5Txrap69Svqk9uouGcWuxq6U25k9lCvkPL1Bj8ITc8Mh0 Aug 07 22:48:09.235464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Id: None Aug 07 22:48:09.235464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Name: None Aug 07 22:48:09.235464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Identity-Status: Confirmed Aug 07 22:48:09.235464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Is-Admin-Project: True Aug 07 22:48:09.235464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Id: default Aug 07 22:48:09.235464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Name: Default Aug 07 22:48:09.235464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Id: 6b3cfd456d8748b3a1db990d638340af Aug 07 22:48:09.235464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Name: tempest-TestVolumeBootPattern-2078404334 Aug 07 22:48:09.235464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Role: reader,member Aug 07 22:48:09.235464 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Roles: reader,member Aug 07 22:48:09.237304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6b3cfd456d8748b3a1db990d638340af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6b3cfd456d8748b3a1db990d638340af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6b3cfd456d8748b3a1db990d638340af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6b3cfd456d8748b3a1db990d638340af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:48:09.237304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant: tempest-TestVolumeBootPattern-2078404334 Aug 07 22:48:09.237304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Id: 6b3cfd456d8748b3a1db990d638340af Aug 07 22:48:09.237304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Name: tempest-TestVolumeBootPattern-2078404334 Aug 07 22:48:09.237304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User: tempest-TestVolumeBootPattern-2078404334-project Aug 07 22:48:09.237304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Id: default Aug 07 22:48:09.237304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Name: Default Aug 07 22:48:09.237304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Id: 394c67bcc3864bb2aca2f4faec834029 Aug 07 22:48:09.237304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Name: tempest-TestVolumeBootPattern-2078404334-project Aug 07 22:48:09.237304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: method: > Aug 07 22:48:09.237304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: exception: Instance fb112b33-4a06-4ff4-832f-aa5d3310bf2a could not be found. Aug 07 22:48:09.237304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: action_args: {'id': 'fb112b33-4a06-4ff4-832f-aa5d3310bf2a'} Aug 07 22:48:09.238179 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:48:09.238179 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:48:09.238179 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:48:09.238179 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:48:09.238179 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:48:09.238179 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:48:09.238179 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:48:09.238179 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:48:09.238179 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:48:09.238179 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:48:09.238179 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb112b33-4a06-4ff4-832f-aa5d3310bf2a could not be found. Aug 07 22:48:09.238179 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:48:09.238179 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:48:09.238179 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:48:09.238179 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:48:09.238179 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:48:09.238179 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:48:09.238179 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:48:09.238179 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:48:09.238179 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:48:09.239487 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:48:09.239487 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:48:09.239487 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:48:09.239487 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:48:09.239487 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:48:09.239487 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:48:09.239487 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:48:09.239487 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb112b33-4a06-4ff4-832f-aa5d3310bf2a could not be found. Aug 07 22:48:09.239487 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:48:09.239487 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:48:09.239487 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:48:09.239487 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:48:09.239487 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:48:09.239487 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:48:09.239487 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:48:09.239487 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:48:09.239487 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb112b33-4a06-4ff4-832f-aa5d3310bf2a could not be found. Aug 07 22:48:09.239487 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:48:09.241218 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-446ed175-f6a9-4672-8bc5-5516ab93cb13 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Returning 404 to user: Instance fb112b33-4a06-4ff4-832f-aa5d3310bf2a could not be found. {{(pid=129965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:48:09.241218 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-446ed175-f6a9-4672-8bc5-5516ab93cb13 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a" status: 404 len: 111 microversion: 2.1 time: 0.030660 Aug 07 22:48:09.241218 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 469/956] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:48:09 2022] GET /compute/v2.1/servers/fb112b33-4a06-4ff4-832f-aa5d3310bf2a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:48:09.519018 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-1e4a3411-e04e-4b8b-9404-7d53ed1710dc tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:09.519622 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-1e4a3411-e04e-4b8b-9404-7d53ed1710dc tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:09.525954 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1e4a3411-e04e-4b8b-9404-7d53ed1710dc tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:09.526424 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1e4a3411-e04e-4b8b-9404-7d53ed1710dc tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:09.526899 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1e4a3411-e04e-4b8b-9404-7d53ed1710dc tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:09.527595 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1e4a3411-e04e-4b8b-9404-7d53ed1710dc tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:09.528140 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1e4a3411-e04e-4b8b-9404-7d53ed1710dc tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:09.528557 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1e4a3411-e04e-4b8b-9404-7d53ed1710dc tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:09.670778 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-1e4a3411-e04e-4b8b-9404-7d53ed1710dc tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:48:09.678502 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-1e4a3411-e04e-4b8b-9404-7d53ed1710dc tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6" status: 200 len: 1362 microversion: 2.1 time: 0.163960 Aug 07 22:48:09.679109 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 488/957] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:48:09 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:48:10.699269 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-1d5ab2aa-83bf-47b9-87c2-f8dfbc725b9a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:10.702387 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-1d5ab2aa-83bf-47b9-87c2-f8dfbc725b9a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:10.707190 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1d5ab2aa-83bf-47b9-87c2-f8dfbc725b9a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:10.707670 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1d5ab2aa-83bf-47b9-87c2-f8dfbc725b9a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:10.708122 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1d5ab2aa-83bf-47b9-87c2-f8dfbc725b9a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:10.708846 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1d5ab2aa-83bf-47b9-87c2-f8dfbc725b9a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:10.709294 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1d5ab2aa-83bf-47b9-87c2-f8dfbc725b9a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:10.709713 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1d5ab2aa-83bf-47b9-87c2-f8dfbc725b9a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:10.836947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-1d5ab2aa-83bf-47b9-87c2-f8dfbc725b9a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:48:10.844594 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-1d5ab2aa-83bf-47b9-87c2-f8dfbc725b9a tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6" status: 200 len: 1362 microversion: 2.1 time: 0.149081 Aug 07 22:48:10.846199 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 470/958] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:48:10 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:48:11.866189 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-4c2fcad1-cf67-4c99-9c9b-ebdabbb4a683 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:11.866917 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-4c2fcad1-cf67-4c99-9c9b-ebdabbb4a683 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:11.873187 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4c2fcad1-cf67-4c99-9c9b-ebdabbb4a683 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:11.873670 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4c2fcad1-cf67-4c99-9c9b-ebdabbb4a683 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:11.874099 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4c2fcad1-cf67-4c99-9c9b-ebdabbb4a683 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:11.874790 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4c2fcad1-cf67-4c99-9c9b-ebdabbb4a683 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:11.875237 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4c2fcad1-cf67-4c99-9c9b-ebdabbb4a683 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:11.875656 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4c2fcad1-cf67-4c99-9c9b-ebdabbb4a683 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:12.076633 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-4c2fcad1-cf67-4c99-9c9b-ebdabbb4a683 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:48:12.084042 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-4c2fcad1-cf67-4c99-9c9b-ebdabbb4a683 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6" status: 200 len: 1362 microversion: 2.1 time: 0.222267 Aug 07 22:48:12.084612 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 489/959] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:48:11 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:48:12.616477 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-fef9a8a3-6ece-48cb-b2f8-3c80438821f2 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:12.616964 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-fef9a8a3-6ece-48cb-b2f8-3c80438821f2 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:12.619488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-9e3eb7ed-32e8-4113-a358-4dcd5ea6b6df req-fa7d1258-7b1e-4155-9cc4-94d76e9aa4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38", "tag": "62940318-36f5-4e66-8a0a-be8fade04295"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:48:12.623580 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fef9a8a3-6ece-48cb-b2f8-3c80438821f2 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:12.624394 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fef9a8a3-6ece-48cb-b2f8-3c80438821f2 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:12.624830 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fef9a8a3-6ece-48cb-b2f8-3c80438821f2 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:12.625777 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fef9a8a3-6ece-48cb-b2f8-3c80438821f2 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:12.626305 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fef9a8a3-6ece-48cb-b2f8-3c80438821f2 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:12.627442 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-fef9a8a3-6ece-48cb-b2f8-3c80438821f2 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:12.627792 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=2 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:48:12.628805 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=6 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:48:12.631217 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-9e3eb7ed-32e8-4113-a358-4dcd5ea6b6df req-fa7d1258-7b1e-4155-9cc4-94d76e9aa4d5 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:12.631854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=6 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:48:12.633084 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-9e3eb7ed-32e8-4113-a358-4dcd5ea6b6df req-fa7d1258-7b1e-4155-9cc4-94d76e9aa4d5 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:12.633513 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-9e3eb7ed-32e8-4113-a358-4dcd5ea6b6df req-fa7d1258-7b1e-4155-9cc4-94d76e9aa4d5 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:12.647095 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-9e3eb7ed-32e8-4113-a358-4dcd5ea6b6df req-fa7d1258-7b1e-4155-9cc4-94d76e9aa4d5 service nova] Creating event network-changed:62940318-36f5-4e66-8a0a-be8fade04295 for instance d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 on hv-cinder-85032 Aug 07 22:48:12.652651 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-9e3eb7ed-32e8-4113-a358-4dcd5ea6b6df req-fa7d1258-7b1e-4155-9cc4-94d76e9aa4d5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036675 Aug 07 22:48:12.653426 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 490/960] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:48:12.653828 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-fef9a8a3-6ece-48cb-b2f8-3c80438821f2 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Going to try to terminate instance {{(pid=129965) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 22:48:12.905315 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-fef9a8a3-6ece-48cb-b2f8-3c80438821f2 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 204 len: 0 microversion: 2.1 time: 0.292660 Aug 07 22:48:12.906104 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 471/961] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:48:12 2022] DELETE /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 22:48:12.916128 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-9062cf0b-620a-4053-9630-eb2d8d3ea447 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:12.916832 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-9062cf0b-620a-4053-9630-eb2d8d3ea447 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:12.925361 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9062cf0b-620a-4053-9630-eb2d8d3ea447 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:12.932152 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9062cf0b-620a-4053-9630-eb2d8d3ea447 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:12.932152 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9062cf0b-620a-4053-9630-eb2d8d3ea447 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:12.932152 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9062cf0b-620a-4053-9630-eb2d8d3ea447 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:12.932152 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9062cf0b-620a-4053-9630-eb2d8d3ea447 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:12.932705 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-9062cf0b-620a-4053-9630-eb2d8d3ea447 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:13.102740 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-9062cf0b-620a-4053-9630-eb2d8d3ea447 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:48:13.106884 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-58a6c468-297b-4102-871d-659ec72878a7 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:13.107593 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-58a6c468-297b-4102-871d-659ec72878a7 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:13.110474 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-9062cf0b-620a-4053-9630-eb2d8d3ea447 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1578 microversion: 2.1 time: 0.199342 Aug 07 22:48:13.112300 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 491/962] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:48:12 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1578 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:48:13.128991 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-58a6c468-297b-4102-871d-659ec72878a7 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:13.130211 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-58a6c468-297b-4102-871d-659ec72878a7 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:13.131046 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-58a6c468-297b-4102-871d-659ec72878a7 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:13.132443 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-58a6c468-297b-4102-871d-659ec72878a7 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:13.132930 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-58a6c468-297b-4102-871d-659ec72878a7 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:13.133371 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-58a6c468-297b-4102-871d-659ec72878a7 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:13.248472 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-dbd84a95-a5de-4432-a27e-9e6d39b12c69 req-30cd00aa-6ae1-4be4-bbb7-dc717dabf0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b093247c-d4ae-470e-b717-2e665540e9d6", "name": "network-vif-plugged", "status": "completed", "tag": "f26c3b4a-e4d6-4e1c-8a50-597ab9ad0659"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:48:13.260784 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-dbd84a95-a5de-4432-a27e-9e6d39b12c69 req-30cd00aa-6ae1-4be4-bbb7-dc717dabf0a8 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:13.261261 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-dbd84a95-a5de-4432-a27e-9e6d39b12c69 req-30cd00aa-6ae1-4be4-bbb7-dc717dabf0a8 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:13.261682 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-dbd84a95-a5de-4432-a27e-9e6d39b12c69 req-30cd00aa-6ae1-4be4-bbb7-dc717dabf0a8 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:13.281154 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-dbd84a95-a5de-4432-a27e-9e6d39b12c69 req-30cd00aa-6ae1-4be4-bbb7-dc717dabf0a8 service nova] Creating event network-vif-plugged:f26c3b4a-e4d6-4e1c-8a50-597ab9ad0659 for instance b093247c-d4ae-470e-b717-2e665540e9d6 on hv-cinder-85032 Aug 07 22:48:13.287493 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-dbd84a95-a5de-4432-a27e-9e6d39b12c69 req-30cd00aa-6ae1-4be4-bbb7-dc717dabf0a8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043872 Aug 07 22:48:13.288391 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 492/963] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:48:13.313474 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-58a6c468-297b-4102-871d-659ec72878a7 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:48:13.321377 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-58a6c468-297b-4102-871d-659ec72878a7 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6" status: 200 len: 1362 microversion: 2.1 time: 0.219339 Aug 07 22:48:13.321952 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 472/964] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:48:13 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:48:14.134084 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b588576e-08f9-44a0-ba79-c9de65b648b6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:14.135371 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-b588576e-08f9-44a0-ba79-c9de65b648b6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:14.143532 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b588576e-08f9-44a0-ba79-c9de65b648b6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:14.144033 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b588576e-08f9-44a0-ba79-c9de65b648b6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:14.144486 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b588576e-08f9-44a0-ba79-c9de65b648b6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:14.145179 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b588576e-08f9-44a0-ba79-c9de65b648b6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:14.145623 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b588576e-08f9-44a0-ba79-c9de65b648b6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:14.146037 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b588576e-08f9-44a0-ba79-c9de65b648b6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:14.342809 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-f2086278-1282-4008-b735-3ca70696cdc8 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:14.344190 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-f2086278-1282-4008-b735-3ca70696cdc8 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:14.362121 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f2086278-1282-4008-b735-3ca70696cdc8 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:14.363415 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f2086278-1282-4008-b735-3ca70696cdc8 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:14.364130 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f2086278-1282-4008-b735-3ca70696cdc8 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:14.364264 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-b588576e-08f9-44a0-ba79-c9de65b648b6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:48:14.365349 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f2086278-1282-4008-b735-3ca70696cdc8 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:14.366007 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f2086278-1282-4008-b735-3ca70696cdc8 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:14.366662 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f2086278-1282-4008-b735-3ca70696cdc8 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:14.378231 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-b588576e-08f9-44a0-ba79-c9de65b648b6 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1578 microversion: 2.1 time: 0.248005 Aug 07 22:48:14.380040 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 493/965] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:48:14 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1578 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:48:14.519700 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f2086278-1282-4008-b735-3ca70696cdc8 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:48:14.527123 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-f2086278-1282-4008-b735-3ca70696cdc8 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6" status: 200 len: 1362 microversion: 2.1 time: 0.188621 Aug 07 22:48:14.527665 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 473/966] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:48:14 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:48:15.343226 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-15375d62-e8d9-46b4-9c10-8e81123ec1b3 req-9f808131-d6b8-4807-ba44-fd8173b0ec04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38", "name": "network-vif-deleted", "tag": "62940318-36f5-4e66-8a0a-be8fade04295"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:48:15.353908 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-15375d62-e8d9-46b4-9c10-8e81123ec1b3 req-9f808131-d6b8-4807-ba44-fd8173b0ec04 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:15.354385 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-15375d62-e8d9-46b4-9c10-8e81123ec1b3 req-9f808131-d6b8-4807-ba44-fd8173b0ec04 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:15.354813 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-15375d62-e8d9-46b4-9c10-8e81123ec1b3 req-9f808131-d6b8-4807-ba44-fd8173b0ec04 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:15.358544 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:48:15.365751 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-15375d62-e8d9-46b4-9c10-8e81123ec1b3 req-9f808131-d6b8-4807-ba44-fd8173b0ec04 service nova] Creating event network-vif-deleted:62940318-36f5-4e66-8a0a-be8fade04295 for instance d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 on hv-cinder-85032 Aug 07 22:48:15.370543 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-15375d62-e8d9-46b4-9c10-8e81123ec1b3 req-9f808131-d6b8-4807-ba44-fd8173b0ec04 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031291 Aug 07 22:48:15.371122 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 494/967] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:48:15.401536 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7ff070af-9503-4102-ac53-8cdd9718ee84 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:15.402151 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-7ff070af-9503-4102-ac53-8cdd9718ee84 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:15.409420 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7ff070af-9503-4102-ac53-8cdd9718ee84 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:15.415306 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7ff070af-9503-4102-ac53-8cdd9718ee84 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:15.415306 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7ff070af-9503-4102-ac53-8cdd9718ee84 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:15.415306 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7ff070af-9503-4102-ac53-8cdd9718ee84 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:15.415306 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7ff070af-9503-4102-ac53-8cdd9718ee84 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:15.415686 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7ff070af-9503-4102-ac53-8cdd9718ee84 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:15.479291 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7ff070af-9503-4102-ac53-8cdd9718ee84 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:48:15.487189 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-7ff070af-9503-4102-ac53-8cdd9718ee84 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1391 microversion: 2.1 time: 0.089444 Aug 07 22:48:15.487764 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 474/968] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:48:15 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1391 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:48:15.548911 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-d410b6d2-29b1-4b96-ad51-7031c4f540aa tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:15.549598 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-d410b6d2-29b1-4b96-ad51-7031c4f540aa tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:15.555988 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d410b6d2-29b1-4b96-ad51-7031c4f540aa tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:15.556485 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d410b6d2-29b1-4b96-ad51-7031c4f540aa tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:15.556919 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d410b6d2-29b1-4b96-ad51-7031c4f540aa tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:15.557599 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d410b6d2-29b1-4b96-ad51-7031c4f540aa tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:15.558060 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d410b6d2-29b1-4b96-ad51-7031c4f540aa tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:15.558471 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d410b6d2-29b1-4b96-ad51-7031c4f540aa tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:15.700701 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-d410b6d2-29b1-4b96-ad51-7031c4f540aa tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:48:15.713541 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-d410b6d2-29b1-4b96-ad51-7031c4f540aa tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6" status: 200 len: 1362 microversion: 2.1 time: 0.169366 Aug 07 22:48:15.714127 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 495/969] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:48:15 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:48:16.508754 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-8d541de8-50f2-4c50-8f0b-d94b609ca0ea tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:16.509369 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-8d541de8-50f2-4c50-8f0b-d94b609ca0ea tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:16.516676 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8d541de8-50f2-4c50-8f0b-d94b609ca0ea tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:16.517291 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8d541de8-50f2-4c50-8f0b-d94b609ca0ea tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:16.517793 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8d541de8-50f2-4c50-8f0b-d94b609ca0ea tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:16.518501 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8d541de8-50f2-4c50-8f0b-d94b609ca0ea tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:16.518957 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8d541de8-50f2-4c50-8f0b-d94b609ca0ea tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:16.519383 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8d541de8-50f2-4c50-8f0b-d94b609ca0ea tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:16.539842 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:48:16.554448 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8d541de8-50f2-4c50-8f0b-d94b609ca0ea tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:16.554933 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8d541de8-50f2-4c50-8f0b-d94b609ca0ea tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:16.555371 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8d541de8-50f2-4c50-8f0b-d94b609ca0ea tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:16.555819 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.objects.instance [None req-8d541de8-50f2-4c50-8f0b-d94b609ca0ea tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lazy-loading 'fault' on Instance uuid d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 {{(pid=129965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:48:16.597244 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8d541de8-50f2-4c50-8f0b-d94b609ca0ea tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394c67bcc3864bb2aca2f4faec834029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3cfd456d8748b3a1db990d638340af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:48:16.604684 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-8d541de8-50f2-4c50-8f0b-d94b609ca0ea tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 200 len: 1230 microversion: 2.1 time: 0.100016 Aug 07 22:48:16.605247 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 475/970] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:48:16 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:48:16.735543 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-33696e74-a247-48cc-affe-afaed6c499f1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:16.736303 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-33696e74-a247-48cc-affe-afaed6c499f1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:16.742741 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-33696e74-a247-48cc-affe-afaed6c499f1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:16.743222 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-33696e74-a247-48cc-affe-afaed6c499f1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:16.743653 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-33696e74-a247-48cc-affe-afaed6c499f1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:16.744393 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-33696e74-a247-48cc-affe-afaed6c499f1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:16.744842 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-33696e74-a247-48cc-affe-afaed6c499f1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:16.745264 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-33696e74-a247-48cc-affe-afaed6c499f1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:16.880654 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-33696e74-a247-48cc-affe-afaed6c499f1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:48:16.888048 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-33696e74-a247-48cc-affe-afaed6c499f1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6" status: 200 len: 1548 microversion: 2.1 time: 0.157219 Aug 07 22:48:16.888871 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 496/971] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:48:16 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:48:16.910415 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-a1c9582e-599d-487c-b081-f5c7b7910cae tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:16.918544 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-a1c9582e-599d-487c-b081-f5c7b7910cae tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:16.918544 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a1c9582e-599d-487c-b081-f5c7b7910cae tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:16.918544 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a1c9582e-599d-487c-b081-f5c7b7910cae tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:16.918544 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a1c9582e-599d-487c-b081-f5c7b7910cae tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:16.918931 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a1c9582e-599d-487c-b081-f5c7b7910cae tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:16.919095 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a1c9582e-599d-487c-b081-f5c7b7910cae tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:16.919515 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a1c9582e-599d-487c-b081-f5c7b7910cae tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:16.996253 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-a1c9582e-599d-487c-b081-f5c7b7910cae tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090593 Aug 07 22:48:16.996850 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 476/972] 10.222.0.30 () {58 vars in 1275 bytes} [Sun Aug 7 22:48:16 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:48:17.626698 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-e6539acc-4d70-443b-a1fb-33faa477571e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:17.627309 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-e6539acc-4d70-443b-a1fb-33faa477571e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:17.634153 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e6539acc-4d70-443b-a1fb-33faa477571e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:17.634634 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e6539acc-4d70-443b-a1fb-33faa477571e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:17.635066 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e6539acc-4d70-443b-a1fb-33faa477571e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:17.635754 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e6539acc-4d70-443b-a1fb-33faa477571e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:17.636233 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e6539acc-4d70-443b-a1fb-33faa477571e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:17.636656 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e6539acc-4d70-443b-a1fb-33faa477571e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:17.650767 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-e6539acc-4d70-443b-a1fb-33faa477571e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] HTTP exception thrown: Instance d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 could not be found. Aug 07 22:48:17.652462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-e6539acc-4d70-443b-a1fb-33faa477571e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Request method failure captured: Aug 07 22:48:17.652462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 HTTP/1.1 Aug 07 22:48:17.652462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:48:17.652462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:48:17.652462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:48:17.652462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:48:17.652462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:48:17.652462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:48:17.652462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:48:17.652462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:48:17.652462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8D887V40Peke5jC_QXWsggzAOgLpyxdi_CaERou7vZSymX0hnbt8UkNtFBgypCBm03NmM2Hk6XjJTocxVbaKwu7bOFYcL67tzHVphf3he2hSGQMyJttsp-GmBJmhjsx8BV5Txrap69Svqk9uouGcWuxq6U25k9lCvkPL1Bj8ITc8Mh0 Aug 07 22:48:17.652462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:48:17.652462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:48:17.652462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:48:17.652462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:48:17.652462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:48:17.652462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:48:17.652462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 6b3cfd456d8748b3a1db990d638340af Aug 07 22:48:17.652462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-TestVolumeBootPattern-2078404334 Aug 07 22:48:17.652462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:48:17.652462 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:48:17.654128 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6b3cfd456d8748b3a1db990d638340af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6b3cfd456d8748b3a1db990d638340af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6b3cfd456d8748b3a1db990d638340af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6b3cfd456d8748b3a1db990d638340af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:48:17.654128 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-TestVolumeBootPattern-2078404334 Aug 07 22:48:17.654128 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 6b3cfd456d8748b3a1db990d638340af Aug 07 22:48:17.654128 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-TestVolumeBootPattern-2078404334 Aug 07 22:48:17.654128 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-TestVolumeBootPattern-2078404334-project Aug 07 22:48:17.654128 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:48:17.654128 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:48:17.654128 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: 394c67bcc3864bb2aca2f4faec834029 Aug 07 22:48:17.654128 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-TestVolumeBootPattern-2078404334-project Aug 07 22:48:17.654128 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: > Aug 07 22:48:17.654128 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Instance d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 could not be found. Aug 07 22:48:17.654128 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': 'd2c54d4b-5ebb-48f8-bcec-b0cb085fdb38'} Aug 07 22:48:17.655200 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:48:17.655200 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:48:17.655200 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:48:17.655200 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:48:17.655200 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:48:17.655200 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:48:17.655200 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:48:17.655200 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:48:17.655200 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:48:17.655200 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:48:17.655200 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 could not be found. Aug 07 22:48:17.655200 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:48:17.655200 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:48:17.655200 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:48:17.655200 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:48:17.655200 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:48:17.655200 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:48:17.655200 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:48:17.655200 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:48:17.655200 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:48:17.656550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:48:17.656550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:48:17.656550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:48:17.656550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:48:17.656550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:48:17.656550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:48:17.656550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:48:17.656550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 could not be found. Aug 07 22:48:17.656550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:48:17.656550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:48:17.656550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:48:17.656550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:48:17.656550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:48:17.656550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:48:17.656550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:48:17.656550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:48:17.656550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 could not be found. Aug 07 22:48:17.656550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:48:17.657795 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-e6539acc-4d70-443b-a1fb-33faa477571e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Returning 404 to user: Instance d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:48:17.657795 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-e6539acc-4d70-443b-a1fb-33faa477571e tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38" status: 404 len: 111 microversion: 2.1 time: 0.031137 Aug 07 22:48:17.657795 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 497/973] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:48:17 2022] GET /compute/v2.1/servers/d2c54d4b-5ebb-48f8-bcec-b0cb085fdb38 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:48:18.181367 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-5149e62a-ca28-4bf9-b02c-da22064375f7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:18.182023 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-5149e62a-ca28-4bf9-b02c-da22064375f7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:18.188371 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5149e62a-ca28-4bf9-b02c-da22064375f7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:18.189057 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5149e62a-ca28-4bf9-b02c-da22064375f7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:18.189605 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5149e62a-ca28-4bf9-b02c-da22064375f7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:18.190421 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5149e62a-ca28-4bf9-b02c-da22064375f7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:18.191050 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5149e62a-ca28-4bf9-b02c-da22064375f7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:18.191578 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5149e62a-ca28-4bf9-b02c-da22064375f7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:18.206677 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.wsgi [None req-5149e62a-ca28-4bf9-b02c-da22064375f7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] HTTP exception thrown: Instance 750b85bc-6bb0-48e2-a912-7664384bcaa0 could not be found. Aug 07 22:48:18.208672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-5149e62a-ca28-4bf9-b02c-da22064375f7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Request method failure captured: Aug 07 22:48:18.208672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: request: DELETE /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 HTTP/1.1 Aug 07 22:48:18.208672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept: application/json Aug 07 22:48:18.208672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept-Encoding: identity Aug 07 22:48:18.208672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Connection: close Aug 07 22:48:18.208672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Length: 0 Aug 07 22:48:18.208672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Type: application/json Aug 07 22:48:18.208672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Host: 10.222.0.30 Aug 07 22:48:18.208672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Openstack-System-Scope: None Aug 07 22:48:18.208672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: User-Agent: python-urllib3/1.26.11 Aug 07 22:48:18.208672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Auth-Token: gAAAAABi8D887V40Peke5jC_QXWsggzAOgLpyxdi_CaERou7vZSymX0hnbt8UkNtFBgypCBm03NmM2Hk6XjJTocxVbaKwu7bOFYcL67tzHVphf3he2hSGQMyJttsp-GmBJmhjsx8BV5Txrap69Svqk9uouGcWuxq6U25k9lCvkPL1Bj8ITc8Mh0 Aug 07 22:48:18.208672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Id: None Aug 07 22:48:18.208672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Name: None Aug 07 22:48:18.208672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Identity-Status: Confirmed Aug 07 22:48:18.208672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Is-Admin-Project: True Aug 07 22:48:18.208672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Id: default Aug 07 22:48:18.208672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Name: Default Aug 07 22:48:18.208672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Id: 6b3cfd456d8748b3a1db990d638340af Aug 07 22:48:18.208672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Name: tempest-TestVolumeBootPattern-2078404334 Aug 07 22:48:18.208672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Role: reader,member Aug 07 22:48:18.208672 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Roles: reader,member Aug 07 22:48:18.210099 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6b3cfd456d8748b3a1db990d638340af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6b3cfd456d8748b3a1db990d638340af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6b3cfd456d8748b3a1db990d638340af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6b3cfd456d8748b3a1db990d638340af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:48:18.210099 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant: tempest-TestVolumeBootPattern-2078404334 Aug 07 22:48:18.210099 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Id: 6b3cfd456d8748b3a1db990d638340af Aug 07 22:48:18.210099 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Name: tempest-TestVolumeBootPattern-2078404334 Aug 07 22:48:18.210099 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User: tempest-TestVolumeBootPattern-2078404334-project Aug 07 22:48:18.210099 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Id: default Aug 07 22:48:18.210099 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Name: Default Aug 07 22:48:18.210099 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Id: 394c67bcc3864bb2aca2f4faec834029 Aug 07 22:48:18.210099 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Name: tempest-TestVolumeBootPattern-2078404334-project Aug 07 22:48:18.210099 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: method: > Aug 07 22:48:18.210099 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: exception: Instance 750b85bc-6bb0-48e2-a912-7664384bcaa0 could not be found. Aug 07 22:48:18.210099 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: action_args: {'id': '750b85bc-6bb0-48e2-a912-7664384bcaa0'} Aug 07 22:48:18.210883 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:48:18.210883 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:48:18.210883 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:48:18.210883 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:48:18.210883 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:48:18.210883 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:48:18.210883 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:48:18.210883 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:48:18.210883 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:48:18.210883 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:48:18.210883 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 750b85bc-6bb0-48e2-a912-7664384bcaa0 could not be found. Aug 07 22:48:18.210883 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:48:18.210883 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:48:18.210883 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:48:18.210883 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:48:18.210883 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:48:18.210883 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:48:18.210883 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:48:18.210883 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:48:18.210883 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:48:18.212706 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:48:18.212706 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 22:48:18.212706 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 22:48:18.212706 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 22:48:18.212706 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 22:48:18.212706 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:48:18.212706 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:48:18.212706 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:48:18.212706 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:48:18.212706 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 750b85bc-6bb0-48e2-a912-7664384bcaa0 could not be found. Aug 07 22:48:18.212706 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:48:18.212706 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:48:18.212706 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:48:18.212706 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:48:18.212706 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:48:18.212706 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:48:18.212706 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:48:18.212706 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:48:18.212706 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 750b85bc-6bb0-48e2-a912-7664384bcaa0 could not be found. Aug 07 22:48:18.212706 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:48:18.214070 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-5149e62a-ca28-4bf9-b02c-da22064375f7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Returning 404 to user: Instance 750b85bc-6bb0-48e2-a912-7664384bcaa0 could not be found. {{(pid=129965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:48:18.215115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-5149e62a-ca28-4bf9-b02c-da22064375f7 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "DELETE /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 404 len: 111 microversion: 2.1 time: 0.040073 Aug 07 22:48:18.215943 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 477/974] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:48:18 2022] DELETE /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:48:18.225053 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-bbaa72fd-99b3-412d-927c-ba88fc8fb655 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:18.225779 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-bbaa72fd-99b3-412d-927c-ba88fc8fb655 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] [instance: 750b85bc-6bb0-48e2-a912-7664384bcaa0] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:18.233240 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bbaa72fd-99b3-412d-927c-ba88fc8fb655 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:18.233823 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bbaa72fd-99b3-412d-927c-ba88fc8fb655 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:18.234386 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bbaa72fd-99b3-412d-927c-ba88fc8fb655 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:18.234907 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-4d3dfb61-626a-4bb9-9e36-c47d74bee19e req-d7847ed2-336f-49aa-8f38-b9cd0dc8df77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b093247c-d4ae-470e-b717-2e665540e9d6", "tag": "f26c3b4a-e4d6-4e1c-8a50-597ab9ad0659"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:48:18.235307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bbaa72fd-99b3-412d-927c-ba88fc8fb655 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:18.235898 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bbaa72fd-99b3-412d-927c-ba88fc8fb655 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:18.236537 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bbaa72fd-99b3-412d-927c-ba88fc8fb655 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:18.245341 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-4d3dfb61-626a-4bb9-9e36-c47d74bee19e req-d7847ed2-336f-49aa-8f38-b9cd0dc8df77 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:18.245819 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-4d3dfb61-626a-4bb9-9e36-c47d74bee19e req-d7847ed2-336f-49aa-8f38-b9cd0dc8df77 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:18.246245 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-4d3dfb61-626a-4bb9-9e36-c47d74bee19e req-d7847ed2-336f-49aa-8f38-b9cd0dc8df77 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:18.253633 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-bbaa72fd-99b3-412d-927c-ba88fc8fb655 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] HTTP exception thrown: Instance 750b85bc-6bb0-48e2-a912-7664384bcaa0 could not be found. Aug 07 22:48:18.255459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-bbaa72fd-99b3-412d-927c-ba88fc8fb655 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Request method failure captured: Aug 07 22:48:18.255459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 HTTP/1.1 Aug 07 22:48:18.255459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:48:18.255459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:48:18.255459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:48:18.255459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:48:18.255459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:48:18.255459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:48:18.255459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:48:18.255459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:48:18.255459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8D887V40Peke5jC_QXWsggzAOgLpyxdi_CaERou7vZSymX0hnbt8UkNtFBgypCBm03NmM2Hk6XjJTocxVbaKwu7bOFYcL67tzHVphf3he2hSGQMyJttsp-GmBJmhjsx8BV5Txrap69Svqk9uouGcWuxq6U25k9lCvkPL1Bj8ITc8Mh0 Aug 07 22:48:18.255459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:48:18.255459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:48:18.255459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:48:18.255459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:48:18.255459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:48:18.255459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:48:18.255459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 6b3cfd456d8748b3a1db990d638340af Aug 07 22:48:18.255459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-TestVolumeBootPattern-2078404334 Aug 07 22:48:18.255459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:48:18.255459 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:48:18.257262 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6b3cfd456d8748b3a1db990d638340af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6b3cfd456d8748b3a1db990d638340af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6b3cfd456d8748b3a1db990d638340af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6b3cfd456d8748b3a1db990d638340af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:48:18.257262 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-TestVolumeBootPattern-2078404334 Aug 07 22:48:18.257262 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 6b3cfd456d8748b3a1db990d638340af Aug 07 22:48:18.257262 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-TestVolumeBootPattern-2078404334 Aug 07 22:48:18.257262 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-TestVolumeBootPattern-2078404334-project Aug 07 22:48:18.257262 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:48:18.257262 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:48:18.257262 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: 394c67bcc3864bb2aca2f4faec834029 Aug 07 22:48:18.257262 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-TestVolumeBootPattern-2078404334-project Aug 07 22:48:18.257262 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: > Aug 07 22:48:18.257262 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Instance 750b85bc-6bb0-48e2-a912-7664384bcaa0 could not be found. Aug 07 22:48:18.257262 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': '750b85bc-6bb0-48e2-a912-7664384bcaa0'} Aug 07 22:48:18.258177 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:48:18.258177 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:48:18.258177 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:48:18.258177 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:48:18.258177 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:48:18.258177 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:48:18.258177 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:48:18.258177 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:48:18.258177 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:48:18.258177 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:48:18.258177 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 750b85bc-6bb0-48e2-a912-7664384bcaa0 could not be found. Aug 07 22:48:18.258177 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:48:18.258177 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:48:18.258177 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:48:18.258177 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:48:18.258177 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:48:18.258177 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:48:18.258177 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:48:18.258177 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:48:18.258177 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:48:18.259815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:48:18.259815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:48:18.259815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:48:18.259815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:48:18.259815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:48:18.259815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:48:18.259815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:48:18.259815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 750b85bc-6bb0-48e2-a912-7664384bcaa0 could not be found. Aug 07 22:48:18.259815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:48:18.259815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:48:18.259815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:48:18.259815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:48:18.259815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:48:18.259815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:48:18.259815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:48:18.259815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:48:18.259815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 750b85bc-6bb0-48e2-a912-7664384bcaa0 could not be found. Aug 07 22:48:18.259815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:48:18.261147 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-bbaa72fd-99b3-412d-927c-ba88fc8fb655 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Returning 404 to user: Instance 750b85bc-6bb0-48e2-a912-7664384bcaa0 could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:48:18.261147 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-bbaa72fd-99b3-412d-927c-ba88fc8fb655 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0" status: 404 len: 111 microversion: 2.1 time: 0.038383 Aug 07 22:48:18.261147 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 498/975] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:48:18 2022] GET /compute/v2.1/servers/750b85bc-6bb0-48e2-a912-7664384bcaa0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 22:48:18.263930 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-4d3dfb61-626a-4bb9-9e36-c47d74bee19e req-d7847ed2-336f-49aa-8f38-b9cd0dc8df77 service nova] Creating event network-changed:f26c3b4a-e4d6-4e1c-8a50-597ab9ad0659 for instance b093247c-d4ae-470e-b717-2e665540e9d6 on hv-cinder-85032 Aug 07 22:48:18.270575 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-4d3dfb61-626a-4bb9-9e36-c47d74bee19e req-d7847ed2-336f-49aa-8f38-b9cd0dc8df77 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039540 Aug 07 22:48:18.271466 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 478/976] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:48:19.776571 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-95044c69-7fa1-41d7-af84-c9069f45e437 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] Calling method '.version_select at 0x7fc09fa9c700>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:19.857983 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-95044c69-7fa1-41d7-af84-c9069f45e437 tempest-TestVolumeBootPattern-2078404334 tempest-TestVolumeBootPattern-2078404334-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-754102463" status: 202 len: 0 microversion: 2.1 time: 0.085245 Aug 07 22:48:19.858597 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 499/977] 10.222.0.30 () {58 vars in 1260 bytes} [Sun Aug 7 22:48:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-754102463 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 22:48:53.015022 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-c72a1364-5128-47cc-8e95-08a93346d789 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:48:53.015578 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-c72a1364-5128-47cc-8e95-08a93346d789 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:53.017807 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:48:53.018441 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=12 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:48:53.023197 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c72a1364-5128-47cc-8e95-08a93346d789 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:53.023680 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c72a1364-5128-47cc-8e95-08a93346d789 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:53.024147 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c72a1364-5128-47cc-8e95-08a93346d789 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:53.024832 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c72a1364-5128-47cc-8e95-08a93346d789 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:53.025281 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c72a1364-5128-47cc-8e95-08a93346d789 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:53.025702 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-c72a1364-5128-47cc-8e95-08a93346d789 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:53.048441 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-c72a1364-5128-47cc-8e95-08a93346d789 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6/ips" status: 200 len: 146 microversion: 2.1 time: 0.038028 Aug 07 22:48:53.053846 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 479/978] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Aug 7 22:48:53 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:48:54.699202 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-e1e95094-b549-4a98-9a7e-073bccf7d560 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a45f9938-a13f-4dd6-aa6f-a4ba5bc8edcf"}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:48:54.701549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-e1e95094-b549-4a98-9a7e-073bccf7d560 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:48:54.703884 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=16 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:48:54.704540 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:48:54.710185 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e1e95094-b549-4a98-9a7e-073bccf7d560 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:54.710667 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e1e95094-b549-4a98-9a7e-073bccf7d560 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:54.711100 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e1e95094-b549-4a98-9a7e-073bccf7d560 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:54.711784 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e1e95094-b549-4a98-9a7e-073bccf7d560 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:48:54.712305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e1e95094-b549-4a98-9a7e-073bccf7d560 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:48:54.712720 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e1e95094-b549-4a98-9a7e-073bccf7d560 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:48:55.385679 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-e1e95094-b549-4a98-9a7e-073bccf7d560 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "POST /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.690559 Aug 07 22:48:55.386301 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 500/979] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 22:48:54 2022] POST /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6/os-volume_attachments => generated 194 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:49:02.904103 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-782bfa63-c9ec-4e3b-b875-816bf756e30d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:02.906297 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-782bfa63-c9ec-4e3b-b875-816bf756e30d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:02.913110 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-782bfa63-c9ec-4e3b-b875-816bf756e30d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:02.913585 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-782bfa63-c9ec-4e3b-b875-816bf756e30d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:02.914014 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-782bfa63-c9ec-4e3b-b875-816bf756e30d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:02.914691 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-782bfa63-c9ec-4e3b-b875-816bf756e30d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:02.915145 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-782bfa63-c9ec-4e3b-b875-816bf756e30d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:02.915564 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-782bfa63-c9ec-4e3b-b875-816bf756e30d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:02.946238 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-782bfa63-c9ec-4e3b-b875-816bf756e30d tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046625 Aug 07 22:49:02.946790 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 480/980] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 22:49:02 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:49:02.958412 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-7fb6bb4d-cbd3-4e81-ab80-431c5edfea98 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:02.958993 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-7fb6bb4d-cbd3-4e81-ab80-431c5edfea98 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:02.966212 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7fb6bb4d-cbd3-4e81-ab80-431c5edfea98 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:02.966693 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7fb6bb4d-cbd3-4e81-ab80-431c5edfea98 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:02.967132 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7fb6bb4d-cbd3-4e81-ab80-431c5edfea98 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:02.967822 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7fb6bb4d-cbd3-4e81-ab80-431c5edfea98 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:02.968335 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7fb6bb4d-cbd3-4e81-ab80-431c5edfea98 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:02.968759 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-7fb6bb4d-cbd3-4e81-ab80-431c5edfea98 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:02.997925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-7fb6bb4d-cbd3-4e81-ab80-431c5edfea98 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6/os-volume_attachments/a45f9938-a13f-4dd6-aa6f-a4ba5bc8edcf" status: 200 len: 194 microversion: 2.1 time: 0.044146 Aug 07 22:49:02.998515 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 501/981] 10.222.0.30 () {58 vars in 1413 bytes} [Sun Aug 7 22:49:02 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6/os-volume_attachments/a45f9938-a13f-4dd6-aa6f-a4ba5bc8edcf => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:49:04.570275 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-02c1476d-d841-405a-90ab-a6196695f448 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2bf4bc47-fbb9-46d4-b1f1-3cbd6f221ef7"}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:49:04.572616 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-02c1476d-d841-405a-90ab-a6196695f448 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:04.579525 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-02c1476d-d841-405a-90ab-a6196695f448 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:04.580003 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-02c1476d-d841-405a-90ab-a6196695f448 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:04.580534 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-02c1476d-d841-405a-90ab-a6196695f448 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:04.581222 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-02c1476d-d841-405a-90ab-a6196695f448 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:04.581680 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-02c1476d-d841-405a-90ab-a6196695f448 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:04.582099 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-02c1476d-d841-405a-90ab-a6196695f448 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:05.248704 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-02c1476d-d841-405a-90ab-a6196695f448 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "POST /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.682075 Aug 07 22:49:05.249234 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 481/982] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 22:49:04 2022] POST /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6/os-volume_attachments => generated 194 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:49:12.769639 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-3a892e95-20f1-420e-ab25-a0f8618d3f33 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:12.776197 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-3a892e95-20f1-420e-ab25-a0f8618d3f33 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:12.778670 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3a892e95-20f1-420e-ab25-a0f8618d3f33 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:12.779154 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3a892e95-20f1-420e-ab25-a0f8618d3f33 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:12.779592 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3a892e95-20f1-420e-ab25-a0f8618d3f33 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:12.780308 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3a892e95-20f1-420e-ab25-a0f8618d3f33 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:12.780766 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3a892e95-20f1-420e-ab25-a0f8618d3f33 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:12.781211 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3a892e95-20f1-420e-ab25-a0f8618d3f33 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:12.811401 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-3a892e95-20f1-420e-ab25-a0f8618d3f33 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045780 Aug 07 22:49:12.812189 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 502/983] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 22:49:12 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:49:12.977396 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-085dd1ae-a0aa-4a65-9823-58ce8fced7ab tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:12.978021 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-085dd1ae-a0aa-4a65-9823-58ce8fced7ab tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:12.984215 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-085dd1ae-a0aa-4a65-9823-58ce8fced7ab tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:12.984695 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-085dd1ae-a0aa-4a65-9823-58ce8fced7ab tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:12.985129 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-085dd1ae-a0aa-4a65-9823-58ce8fced7ab tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:12.985818 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-085dd1ae-a0aa-4a65-9823-58ce8fced7ab tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:12.986269 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-085dd1ae-a0aa-4a65-9823-58ce8fced7ab tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:12.986693 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-085dd1ae-a0aa-4a65-9823-58ce8fced7ab tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:13.016099 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-085dd1ae-a0aa-4a65-9823-58ce8fced7ab tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6/os-volume_attachments/a45f9938-a13f-4dd6-aa6f-a4ba5bc8edcf" status: 200 len: 194 microversion: 2.1 time: 0.043711 Aug 07 22:49:13.016678 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 482/984] 10.222.0.30 () {58 vars in 1413 bytes} [Sun Aug 7 22:49:12 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6/os-volume_attachments/a45f9938-a13f-4dd6-aa6f-a4ba5bc8edcf => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:49:13.026896 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-65f6f65a-a699-4dc8-97b2-9a3398540323 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:13.027396 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-65f6f65a-a699-4dc8-97b2-9a3398540323 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:13.033322 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-65f6f65a-a699-4dc8-97b2-9a3398540323 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:13.033806 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-65f6f65a-a699-4dc8-97b2-9a3398540323 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:13.034244 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-65f6f65a-a699-4dc8-97b2-9a3398540323 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:13.034929 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-65f6f65a-a699-4dc8-97b2-9a3398540323 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:13.035390 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-65f6f65a-a699-4dc8-97b2-9a3398540323 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:13.035817 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-65f6f65a-a699-4dc8-97b2-9a3398540323 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:13.115935 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.objects.instance [None req-65f6f65a-a699-4dc8-97b2-9a3398540323 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lazy-loading 'services' on Instance uuid b093247c-d4ae-470e-b717-2e665540e9d6 {{(pid=129964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:49:13.315193 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-65f6f65a-a699-4dc8-97b2-9a3398540323 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6/os-volume_attachments/a45f9938-a13f-4dd6-aa6f-a4ba5bc8edcf" status: 202 len: 0 microversion: 2.1 time: 0.292010 Aug 07 22:49:13.315776 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 503/985] 10.222.0.30 () {58 vars in 1416 bytes} [Sun Aug 7 22:49:13 2022] DELETE /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6/os-volume_attachments/a45f9938-a13f-4dd6-aa6f-a4ba5bc8edcf => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:49:15.488819 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-1713766a-12ce-4195-b0bf-d29add1302ec tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:15.489339 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-1713766a-12ce-4195-b0bf-d29add1302ec tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:15.496786 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1713766a-12ce-4195-b0bf-d29add1302ec tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:15.497257 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1713766a-12ce-4195-b0bf-d29add1302ec tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:15.497841 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1713766a-12ce-4195-b0bf-d29add1302ec tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:15.498560 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1713766a-12ce-4195-b0bf-d29add1302ec tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:15.499013 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1713766a-12ce-4195-b0bf-d29add1302ec tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:15.499430 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1713766a-12ce-4195-b0bf-d29add1302ec tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:15.528369 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-1713766a-12ce-4195-b0bf-d29add1302ec tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6/os-volume_attachments/2bf4bc47-fbb9-46d4-b1f1-3cbd6f221ef7" status: 200 len: 194 microversion: 2.1 time: 0.043402 Aug 07 22:49:15.528873 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 483/986] 10.222.0.30 () {58 vars in 1413 bytes} [Sun Aug 7 22:49:15 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6/os-volume_attachments/2bf4bc47-fbb9-46d4-b1f1-3cbd6f221ef7 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:49:15.540864 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-e801f83b-56dd-4379-b27a-d704538d6f74 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:15.541441 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-e801f83b-56dd-4379-b27a-d704538d6f74 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:15.547450 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e801f83b-56dd-4379-b27a-d704538d6f74 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:15.547925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e801f83b-56dd-4379-b27a-d704538d6f74 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:15.548395 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e801f83b-56dd-4379-b27a-d704538d6f74 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:15.549074 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e801f83b-56dd-4379-b27a-d704538d6f74 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:15.549521 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e801f83b-56dd-4379-b27a-d704538d6f74 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:15.549941 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e801f83b-56dd-4379-b27a-d704538d6f74 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:15.629827 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.objects.instance [None req-e801f83b-56dd-4379-b27a-d704538d6f74 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lazy-loading 'services' on Instance uuid b093247c-d4ae-470e-b717-2e665540e9d6 {{(pid=129964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:49:15.858070 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-e801f83b-56dd-4379-b27a-d704538d6f74 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6/os-volume_attachments/2bf4bc47-fbb9-46d4-b1f1-3cbd6f221ef7" status: 202 len: 0 microversion: 2.1 time: 0.322399 Aug 07 22:49:15.858727 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 504/987] 10.222.0.30 () {58 vars in 1416 bytes} [Sun Aug 7 22:49:15 2022] DELETE /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6/os-volume_attachments/2bf4bc47-fbb9-46d4-b1f1-3cbd6f221ef7 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:49:17.025424 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-03792397-e082-4dbf-9d33-ca47db81cf2e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:17.027694 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-03792397-e082-4dbf-9d33-ca47db81cf2e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:17.034032 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-03792397-e082-4dbf-9d33-ca47db81cf2e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:17.034511 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-03792397-e082-4dbf-9d33-ca47db81cf2e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:17.034947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-03792397-e082-4dbf-9d33-ca47db81cf2e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:17.035625 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-03792397-e082-4dbf-9d33-ca47db81cf2e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:17.036104 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-03792397-e082-4dbf-9d33-ca47db81cf2e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:17.036525 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-03792397-e082-4dbf-9d33-ca47db81cf2e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:17.064707 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-03792397-e082-4dbf-9d33-ca47db81cf2e tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043909 Aug 07 22:49:17.065241 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 484/988] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 22:49:17 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 22:49:17.175157 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-1f16bdb6-bf8d-4acd-a422-92bfdbfb2ede tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:17.177396 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-1f16bdb6-bf8d-4acd-a422-92bfdbfb2ede tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:17.184120 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1f16bdb6-bf8d-4acd-a422-92bfdbfb2ede tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:17.184596 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1f16bdb6-bf8d-4acd-a422-92bfdbfb2ede tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:17.185022 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1f16bdb6-bf8d-4acd-a422-92bfdbfb2ede tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:17.185702 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1f16bdb6-bf8d-4acd-a422-92bfdbfb2ede tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:17.186147 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1f16bdb6-bf8d-4acd-a422-92bfdbfb2ede tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:17.186562 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1f16bdb6-bf8d-4acd-a422-92bfdbfb2ede tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:17.214508 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-1f16bdb6-bf8d-4acd-a422-92bfdbfb2ede tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044087 Aug 07 22:49:17.215045 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 505/989] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 22:49:17 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 22:49:17.276755 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-a16bc719-9457-4643-b8c0-764875727246 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:17.277536 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-a16bc719-9457-4643-b8c0-764875727246 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:17.283181 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a16bc719-9457-4643-b8c0-764875727246 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:17.283666 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a16bc719-9457-4643-b8c0-764875727246 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:17.284212 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a16bc719-9457-4643-b8c0-764875727246 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:17.284904 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a16bc719-9457-4643-b8c0-764875727246 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:17.285354 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a16bc719-9457-4643-b8c0-764875727246 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:17.285779 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a16bc719-9457-4643-b8c0-764875727246 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:17.311007 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-a16bc719-9457-4643-b8c0-764875727246 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Going to try to terminate instance {{(pid=129965) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 22:49:17.584105 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-a16bc719-9457-4643-b8c0-764875727246 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6" status: 204 len: 0 microversion: 2.1 time: 0.311455 Aug 07 22:49:17.584687 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 485/990] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:49:17 2022] DELETE /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 22:49:17.593054 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-6774db63-7f3f-493c-a776-9f9e258bd1b4 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:17.593663 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-6774db63-7f3f-493c-a776-9f9e258bd1b4 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:17.599560 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6774db63-7f3f-493c-a776-9f9e258bd1b4 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:17.600066 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6774db63-7f3f-493c-a776-9f9e258bd1b4 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:17.600508 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6774db63-7f3f-493c-a776-9f9e258bd1b4 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:17.601802 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6774db63-7f3f-493c-a776-9f9e258bd1b4 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:17.602231 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6774db63-7f3f-493c-a776-9f9e258bd1b4 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:17.602655 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6774db63-7f3f-493c-a776-9f9e258bd1b4 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:17.734360 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-6774db63-7f3f-493c-a776-9f9e258bd1b4 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:49:17.742697 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-6774db63-7f3f-493c-a776-9f9e258bd1b4 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6" status: 200 len: 1673 microversion: 2.1 time: 0.152640 Aug 07 22:49:17.743348 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 506/991] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:49:17 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:49:18.764747 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-549b8f6d-c06a-4889-99f0-f89a7d87c4e1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:18.765443 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-549b8f6d-c06a-4889-99f0-f89a7d87c4e1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:18.771851 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-549b8f6d-c06a-4889-99f0-f89a7d87c4e1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:18.772363 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-549b8f6d-c06a-4889-99f0-f89a7d87c4e1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:18.773324 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-549b8f6d-c06a-4889-99f0-f89a7d87c4e1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:18.774201 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-549b8f6d-c06a-4889-99f0-f89a7d87c4e1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:18.774651 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-549b8f6d-c06a-4889-99f0-f89a7d87c4e1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:18.775068 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-549b8f6d-c06a-4889-99f0-f89a7d87c4e1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:18.901831 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-549b8f6d-c06a-4889-99f0-f89a7d87c4e1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:49:18.909257 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-549b8f6d-c06a-4889-99f0-f89a7d87c4e1 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6" status: 200 len: 1673 microversion: 2.1 time: 0.149002 Aug 07 22:49:18.909812 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 486/992] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:49:18 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:49:19.930786 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-179c9f69-39b6-4d8e-ba06-9136bb3ff503 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:19.931401 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-179c9f69-39b6-4d8e-ba06-9136bb3ff503 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:19.937964 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-179c9f69-39b6-4d8e-ba06-9136bb3ff503 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:19.938454 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-179c9f69-39b6-4d8e-ba06-9136bb3ff503 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:19.938890 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-179c9f69-39b6-4d8e-ba06-9136bb3ff503 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:19.939605 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-179c9f69-39b6-4d8e-ba06-9136bb3ff503 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:19.940150 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-179c9f69-39b6-4d8e-ba06-9136bb3ff503 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:19.940579 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-179c9f69-39b6-4d8e-ba06-9136bb3ff503 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:20.073048 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-179c9f69-39b6-4d8e-ba06-9136bb3ff503 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:49:20.080782 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-179c9f69-39b6-4d8e-ba06-9136bb3ff503 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6" status: 200 len: 1673 microversion: 2.1 time: 0.153992 Aug 07 22:49:20.081359 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 507/993] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:49:19 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:49:20.585904 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-b581210c-83f9-43b2-b3bc-d33863f08946 req-ac0816e5-4a15-4c5f-88ca-331187f78e72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b093247c-d4ae-470e-b717-2e665540e9d6", "name": "network-vif-deleted", "tag": "f26c3b4a-e4d6-4e1c-8a50-597ab9ad0659"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:49:20.608115 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-b581210c-83f9-43b2-b3bc-d33863f08946 req-ac0816e5-4a15-4c5f-88ca-331187f78e72 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:20.608886 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-b581210c-83f9-43b2-b3bc-d33863f08946 req-ac0816e5-4a15-4c5f-88ca-331187f78e72 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:20.609314 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-b581210c-83f9-43b2-b3bc-d33863f08946 req-ac0816e5-4a15-4c5f-88ca-331187f78e72 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:20.621049 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-b581210c-83f9-43b2-b3bc-d33863f08946 req-ac0816e5-4a15-4c5f-88ca-331187f78e72 service nova] Creating event network-vif-deleted:f26c3b4a-e4d6-4e1c-8a50-597ab9ad0659 for instance b093247c-d4ae-470e-b717-2e665540e9d6 on hv-cinder-85032 Aug 07 22:49:20.626253 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-b581210c-83f9-43b2-b3bc-d33863f08946 req-ac0816e5-4a15-4c5f-88ca-331187f78e72 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.237813 Aug 07 22:49:20.631127 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 487/994] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:49:21.101932 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-fd21a9a6-33cb-4e6f-a956-5285099d576b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:21.102712 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-fd21a9a6-33cb-4e6f-a956-5285099d576b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:21.109202 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fd21a9a6-33cb-4e6f-a956-5285099d576b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:21.109684 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fd21a9a6-33cb-4e6f-a956-5285099d576b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:21.110118 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fd21a9a6-33cb-4e6f-a956-5285099d576b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:21.110803 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fd21a9a6-33cb-4e6f-a956-5285099d576b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:21.111434 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fd21a9a6-33cb-4e6f-a956-5285099d576b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:21.111712 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fd21a9a6-33cb-4e6f-a956-5285099d576b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:21.146843 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fd21a9a6-33cb-4e6f-a956-5285099d576b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:21.147325 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fd21a9a6-33cb-4e6f-a956-5285099d576b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:21.147755 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fd21a9a6-33cb-4e6f-a956-5285099d576b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:21.154493 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.objects.instance [None req-fd21a9a6-33cb-4e6f-a956-5285099d576b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lazy-loading 'fault' on Instance uuid b093247c-d4ae-470e-b717-2e665540e9d6 {{(pid=129964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:49:21.193295 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-fd21a9a6-33cb-4e6f-a956-5285099d576b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990056333138468c99292c3f00605e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66028a147f42e1aa29abd7c22d00f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:49:21.202117 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-fd21a9a6-33cb-4e6f-a956-5285099d576b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6" status: 200 len: 1327 microversion: 2.1 time: 0.104048 Aug 07 22:49:21.211939 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 508/995] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:49:21 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6 => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:49:22.226969 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-3ff3bb25-12b6-4b25-a151-db8d6bf7f2ad tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:22.227586 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-3ff3bb25-12b6-4b25-a151-db8d6bf7f2ad tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:22.233717 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3ff3bb25-12b6-4b25-a151-db8d6bf7f2ad tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:22.234189 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3ff3bb25-12b6-4b25-a151-db8d6bf7f2ad tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:22.234620 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3ff3bb25-12b6-4b25-a151-db8d6bf7f2ad tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:22.235295 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3ff3bb25-12b6-4b25-a151-db8d6bf7f2ad tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:22.235744 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3ff3bb25-12b6-4b25-a151-db8d6bf7f2ad tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:22.236192 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3ff3bb25-12b6-4b25-a151-db8d6bf7f2ad tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:22.249038 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.wsgi [None req-3ff3bb25-12b6-4b25-a151-db8d6bf7f2ad tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] HTTP exception thrown: Instance b093247c-d4ae-470e-b717-2e665540e9d6 could not be found. Aug 07 22:49:22.250635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-3ff3bb25-12b6-4b25-a151-db8d6bf7f2ad tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Request method failure captured: Aug 07 22:49:22.250635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: request: GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6 HTTP/1.1 Aug 07 22:49:22.250635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept: application/json Aug 07 22:49:22.250635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept-Encoding: identity Aug 07 22:49:22.250635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Connection: close Aug 07 22:49:22.250635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Length: 0 Aug 07 22:49:22.250635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Type: application/json Aug 07 22:49:22.250635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Host: 10.222.0.30 Aug 07 22:49:22.250635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Openstack-System-Scope: None Aug 07 22:49:22.250635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: User-Agent: python-urllib3/1.26.11 Aug 07 22:49:22.250635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Auth-Token: gAAAAABi8EB1dUYsBPce-qUgdyzouxxiPwXLhFmQ622zM7d_DY6IAOwVwk2k1UVunNiTbS8jXHlj-b6Re9GcDYS6W8mOqCGd4WfZoUCThkWNdhfhobgHXXSVTwgd5KyDzd9MGoY4ljapEHDIYgKK4L0eG097UTU5PC-61wsSMlwlp5AHNclHUhk Aug 07 22:49:22.250635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Id: None Aug 07 22:49:22.250635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Name: None Aug 07 22:49:22.250635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Identity-Status: Confirmed Aug 07 22:49:22.250635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Is-Admin-Project: True Aug 07 22:49:22.250635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Id: default Aug 07 22:49:22.250635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Name: Default Aug 07 22:49:22.250635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Id: dd66028a147f42e1aa29abd7c22d00f9 Aug 07 22:49:22.250635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Name: tempest-AttachVolumeTestJSON-209546250 Aug 07 22:49:22.250635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Role: reader,member Aug 07 22:49:22.250635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Roles: reader,member Aug 07 22:49:22.252299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dd66028a147f42e1aa29abd7c22d00f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dd66028a147f42e1aa29abd7c22d00f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dd66028a147f42e1aa29abd7c22d00f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dd66028a147f42e1aa29abd7c22d00f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:49:22.252299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant: tempest-AttachVolumeTestJSON-209546250 Aug 07 22:49:22.252299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Id: dd66028a147f42e1aa29abd7c22d00f9 Aug 07 22:49:22.252299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Name: tempest-AttachVolumeTestJSON-209546250 Aug 07 22:49:22.252299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User: tempest-AttachVolumeTestJSON-209546250-project Aug 07 22:49:22.252299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Id: default Aug 07 22:49:22.252299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Name: Default Aug 07 22:49:22.252299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Id: 990056333138468c99292c3f00605e6c Aug 07 22:49:22.252299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Name: tempest-AttachVolumeTestJSON-209546250-project Aug 07 22:49:22.252299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: method: > Aug 07 22:49:22.252299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: exception: Instance b093247c-d4ae-470e-b717-2e665540e9d6 could not be found. Aug 07 22:49:22.252299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: action_args: {'id': 'b093247c-d4ae-470e-b717-2e665540e9d6'} Aug 07 22:49:22.253392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:49:22.253392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:49:22.253392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:49:22.253392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:49:22.253392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:49:22.253392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:49:22.253392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:49:22.253392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:49:22.253392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:49:22.253392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:49:22.253392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b093247c-d4ae-470e-b717-2e665540e9d6 could not be found. Aug 07 22:49:22.253392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:49:22.253392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:49:22.253392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:49:22.253392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:49:22.253392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:49:22.253392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:49:22.253392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:49:22.253392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:49:22.253392 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:49:22.254942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:49:22.254942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:49:22.254942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:49:22.254942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:49:22.254942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:49:22.254942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:49:22.254942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:49:22.254942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b093247c-d4ae-470e-b717-2e665540e9d6 could not be found. Aug 07 22:49:22.254942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:49:22.254942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:49:22.254942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:49:22.254942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:49:22.254942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:49:22.254942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:49:22.254942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:49:22.254942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:49:22.254942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b093247c-d4ae-470e-b717-2e665540e9d6 could not be found. Aug 07 22:49:22.254942 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:49:22.256437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-3ff3bb25-12b6-4b25-a151-db8d6bf7f2ad tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Returning 404 to user: Instance b093247c-d4ae-470e-b717-2e665540e9d6 could not be found. {{(pid=129965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:49:22.256437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-3ff3bb25-12b6-4b25-a151-db8d6bf7f2ad tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6" status: 404 len: 111 microversion: 2.1 time: 0.030030 Aug 07 22:49:22.256437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 488/996] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:49:22 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:49:22.261135 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-30ad2914-c0a1-4d4b-919a-3237cbbc679b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '.version_select at 0x7fc09fb35820>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:22.362411 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-30ad2914-c0a1-4d4b-919a-3237cbbc679b tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1127876051" status: 202 len: 0 microversion: 2.1 time: 0.105463 Aug 07 22:49:22.362988 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 509/997] 10.222.0.30 () {58 vars in 1221 bytes} [Sun Aug 7 22:49:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1127876051 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:49:25.645440 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-f5fc093c-76e5-49a9-a874-b9793e75ced7 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:25.645955 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-f5fc093c-76e5-49a9-a874-b9793e75ced7 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:25.652528 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f5fc093c-76e5-49a9-a874-b9793e75ced7 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:25.653559 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f5fc093c-76e5-49a9-a874-b9793e75ced7 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:25.653559 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f5fc093c-76e5-49a9-a874-b9793e75ced7 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:25.654139 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f5fc093c-76e5-49a9-a874-b9793e75ced7 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:25.654598 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f5fc093c-76e5-49a9-a874-b9793e75ced7 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:25.655024 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-f5fc093c-76e5-49a9-a874-b9793e75ced7 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:25.669742 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.wsgi [None req-f5fc093c-76e5-49a9-a874-b9793e75ced7 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] HTTP exception thrown: Instance b093247c-d4ae-470e-b717-2e665540e9d6 could not be found. Aug 07 22:49:25.671268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-f5fc093c-76e5-49a9-a874-b9793e75ced7 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Request method failure captured: Aug 07 22:49:25.671268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: request: DELETE /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6 HTTP/1.1 Aug 07 22:49:25.671268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept: application/json Aug 07 22:49:25.671268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept-Encoding: identity Aug 07 22:49:25.671268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Connection: close Aug 07 22:49:25.671268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Length: 0 Aug 07 22:49:25.671268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Type: application/json Aug 07 22:49:25.671268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Host: 10.222.0.30 Aug 07 22:49:25.671268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Openstack-System-Scope: None Aug 07 22:49:25.671268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: User-Agent: python-urllib3/1.26.11 Aug 07 22:49:25.671268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Auth-Token: gAAAAABi8EB1dUYsBPce-qUgdyzouxxiPwXLhFmQ622zM7d_DY6IAOwVwk2k1UVunNiTbS8jXHlj-b6Re9GcDYS6W8mOqCGd4WfZoUCThkWNdhfhobgHXXSVTwgd5KyDzd9MGoY4ljapEHDIYgKK4L0eG097UTU5PC-61wsSMlwlp5AHNclHUhk Aug 07 22:49:25.671268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Id: None Aug 07 22:49:25.671268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Name: None Aug 07 22:49:25.671268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Identity-Status: Confirmed Aug 07 22:49:25.671268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Is-Admin-Project: True Aug 07 22:49:25.671268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Id: default Aug 07 22:49:25.671268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Name: Default Aug 07 22:49:25.671268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Id: dd66028a147f42e1aa29abd7c22d00f9 Aug 07 22:49:25.671268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Name: tempest-AttachVolumeTestJSON-209546250 Aug 07 22:49:25.671268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Role: reader,member Aug 07 22:49:25.671268 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Roles: reader,member Aug 07 22:49:25.672881 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dd66028a147f42e1aa29abd7c22d00f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dd66028a147f42e1aa29abd7c22d00f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dd66028a147f42e1aa29abd7c22d00f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dd66028a147f42e1aa29abd7c22d00f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:49:25.672881 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant: tempest-AttachVolumeTestJSON-209546250 Aug 07 22:49:25.672881 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Id: dd66028a147f42e1aa29abd7c22d00f9 Aug 07 22:49:25.672881 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Name: tempest-AttachVolumeTestJSON-209546250 Aug 07 22:49:25.672881 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User: tempest-AttachVolumeTestJSON-209546250-project Aug 07 22:49:25.672881 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Id: default Aug 07 22:49:25.672881 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Name: Default Aug 07 22:49:25.672881 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Id: 990056333138468c99292c3f00605e6c Aug 07 22:49:25.672881 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Name: tempest-AttachVolumeTestJSON-209546250-project Aug 07 22:49:25.672881 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: method: > Aug 07 22:49:25.672881 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: exception: Instance b093247c-d4ae-470e-b717-2e665540e9d6 could not be found. Aug 07 22:49:25.672881 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: action_args: {'id': 'b093247c-d4ae-470e-b717-2e665540e9d6'} Aug 07 22:49:25.673697 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:49:25.673697 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:49:25.673697 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:49:25.673697 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:49:25.673697 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:49:25.673697 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:49:25.673697 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:49:25.673697 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:49:25.673697 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:49:25.673697 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:49:25.673697 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b093247c-d4ae-470e-b717-2e665540e9d6 could not be found. Aug 07 22:49:25.673697 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:49:25.673697 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:49:25.673697 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:49:25.673697 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:49:25.673697 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:49:25.673697 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:49:25.673697 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:49:25.673697 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:49:25.673697 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:49:25.674961 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:49:25.674961 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 22:49:25.674961 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 22:49:25.674961 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 22:49:25.674961 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 22:49:25.674961 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:49:25.674961 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:49:25.674961 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:49:25.674961 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:49:25.674961 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b093247c-d4ae-470e-b717-2e665540e9d6 could not be found. Aug 07 22:49:25.674961 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:49:25.674961 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:49:25.674961 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:49:25.674961 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:49:25.674961 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:49:25.674961 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:49:25.674961 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:49:25.674961 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:49:25.674961 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b093247c-d4ae-470e-b717-2e665540e9d6 could not be found. Aug 07 22:49:25.674961 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:49:25.676222 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-f5fc093c-76e5-49a9-a874-b9793e75ced7 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Returning 404 to user: Instance b093247c-d4ae-470e-b717-2e665540e9d6 could not be found. {{(pid=129965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:49:25.676222 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-f5fc093c-76e5-49a9-a874-b9793e75ced7 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6" status: 404 len: 111 microversion: 2.1 time: 0.031178 Aug 07 22:49:25.676222 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 489/998] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:49:25 2022] DELETE /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:49:25.682573 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-eccaccdb-1bbd-400a-97f4-fe8193e82523 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:25.683213 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-eccaccdb-1bbd-400a-97f4-fe8193e82523 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: b093247c-d4ae-470e-b717-2e665540e9d6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:25.685295 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:49:25.690722 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-eccaccdb-1bbd-400a-97f4-fe8193e82523 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:25.691228 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-eccaccdb-1bbd-400a-97f4-fe8193e82523 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:25.691659 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-eccaccdb-1bbd-400a-97f4-fe8193e82523 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:25.692382 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-eccaccdb-1bbd-400a-97f4-fe8193e82523 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:25.692828 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-eccaccdb-1bbd-400a-97f4-fe8193e82523 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:25.693244 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-eccaccdb-1bbd-400a-97f4-fe8193e82523 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:25.696398 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:49:25.707228 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-eccaccdb-1bbd-400a-97f4-fe8193e82523 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] HTTP exception thrown: Instance b093247c-d4ae-470e-b717-2e665540e9d6 could not be found. Aug 07 22:49:25.708858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-eccaccdb-1bbd-400a-97f4-fe8193e82523 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Request method failure captured: Aug 07 22:49:25.708858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6 HTTP/1.1 Aug 07 22:49:25.708858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:49:25.708858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:49:25.708858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:49:25.708858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:49:25.708858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:49:25.708858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:49:25.708858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:49:25.708858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:49:25.708858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8EB1dUYsBPce-qUgdyzouxxiPwXLhFmQ622zM7d_DY6IAOwVwk2k1UVunNiTbS8jXHlj-b6Re9GcDYS6W8mOqCGd4WfZoUCThkWNdhfhobgHXXSVTwgd5KyDzd9MGoY4ljapEHDIYgKK4L0eG097UTU5PC-61wsSMlwlp5AHNclHUhk Aug 07 22:49:25.708858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:49:25.708858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:49:25.708858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:49:25.708858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:49:25.708858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:49:25.708858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:49:25.708858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: dd66028a147f42e1aa29abd7c22d00f9 Aug 07 22:49:25.708858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-AttachVolumeTestJSON-209546250 Aug 07 22:49:25.708858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:49:25.708858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:49:25.710410 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dd66028a147f42e1aa29abd7c22d00f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dd66028a147f42e1aa29abd7c22d00f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dd66028a147f42e1aa29abd7c22d00f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dd66028a147f42e1aa29abd7c22d00f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:49:25.710410 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-AttachVolumeTestJSON-209546250 Aug 07 22:49:25.710410 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: dd66028a147f42e1aa29abd7c22d00f9 Aug 07 22:49:25.710410 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-AttachVolumeTestJSON-209546250 Aug 07 22:49:25.710410 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-AttachVolumeTestJSON-209546250-project Aug 07 22:49:25.710410 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:49:25.710410 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:49:25.710410 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: 990056333138468c99292c3f00605e6c Aug 07 22:49:25.710410 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-AttachVolumeTestJSON-209546250-project Aug 07 22:49:25.710410 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: > Aug 07 22:49:25.710410 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Instance b093247c-d4ae-470e-b717-2e665540e9d6 could not be found. Aug 07 22:49:25.710410 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': 'b093247c-d4ae-470e-b717-2e665540e9d6'} Aug 07 22:49:25.711513 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:49:25.711513 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:49:25.711513 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:49:25.711513 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:49:25.711513 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:49:25.711513 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:49:25.711513 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:49:25.711513 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:49:25.711513 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:49:25.711513 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:49:25.711513 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b093247c-d4ae-470e-b717-2e665540e9d6 could not be found. Aug 07 22:49:25.711513 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:49:25.711513 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:49:25.711513 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:49:25.711513 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:49:25.711513 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:49:25.711513 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:49:25.711513 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:49:25.711513 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:49:25.711513 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:49:25.713039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:49:25.713039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:49:25.713039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:49:25.713039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:49:25.713039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:49:25.713039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:49:25.713039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:49:25.713039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b093247c-d4ae-470e-b717-2e665540e9d6 could not be found. Aug 07 22:49:25.713039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:49:25.713039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:49:25.713039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:49:25.713039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:49:25.713039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:49:25.713039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:49:25.713039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:49:25.713039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:49:25.713039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b093247c-d4ae-470e-b717-2e665540e9d6 could not be found. Aug 07 22:49:25.713039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:49:25.714421 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-eccaccdb-1bbd-400a-97f4-fe8193e82523 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Returning 404 to user: Instance b093247c-d4ae-470e-b717-2e665540e9d6 could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:49:25.714421 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-eccaccdb-1bbd-400a-97f4-fe8193e82523 tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6" status: 404 len: 111 microversion: 2.1 time: 0.032824 Aug 07 22:49:25.714421 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 510/999] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:49:25 2022] GET /compute/v2.1/servers/b093247c-d4ae-470e-b717-2e665540e9d6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:49:26.974820 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ad2c3272-8c5c-4db6-868a-4c62ff93d19f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:26.975326 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-ad2c3272-8c5c-4db6-868a-4c62ff93d19f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:26.982477 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad2c3272-8c5c-4db6-868a-4c62ff93d19f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:26.982952 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad2c3272-8c5c-4db6-868a-4c62ff93d19f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:26.983384 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad2c3272-8c5c-4db6-868a-4c62ff93d19f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:26.984093 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad2c3272-8c5c-4db6-868a-4c62ff93d19f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:26.984546 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad2c3272-8c5c-4db6-868a-4c62ff93d19f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:26.984964 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad2c3272-8c5c-4db6-868a-4c62ff93d19f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:26.997894 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.wsgi [None req-ad2c3272-8c5c-4db6-868a-4c62ff93d19f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] HTTP exception thrown: Instance 3243af5d-9b7f-4839-9877-cf6edb147c8b could not be found. Aug 07 22:49:26.999409 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ad2c3272-8c5c-4db6-868a-4c62ff93d19f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Request method failure captured: Aug 07 22:49:26.999409 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: request: DELETE /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b HTTP/1.1 Aug 07 22:49:26.999409 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept: application/json Aug 07 22:49:26.999409 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept-Encoding: identity Aug 07 22:49:26.999409 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Connection: close Aug 07 22:49:26.999409 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Length: 0 Aug 07 22:49:26.999409 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Type: application/json Aug 07 22:49:26.999409 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Host: 10.222.0.30 Aug 07 22:49:26.999409 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Openstack-System-Scope: None Aug 07 22:49:26.999409 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: User-Agent: python-urllib3/1.26.11 Aug 07 22:49:26.999409 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Auth-Token: gAAAAABi8EB1dUYsBPce-qUgdyzouxxiPwXLhFmQ622zM7d_DY6IAOwVwk2k1UVunNiTbS8jXHlj-b6Re9GcDYS6W8mOqCGd4WfZoUCThkWNdhfhobgHXXSVTwgd5KyDzd9MGoY4ljapEHDIYgKK4L0eG097UTU5PC-61wsSMlwlp5AHNclHUhk Aug 07 22:49:26.999409 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Id: None Aug 07 22:49:26.999409 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Name: None Aug 07 22:49:26.999409 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Identity-Status: Confirmed Aug 07 22:49:26.999409 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Is-Admin-Project: True Aug 07 22:49:26.999409 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Id: default Aug 07 22:49:26.999409 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Name: Default Aug 07 22:49:26.999409 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Id: dd66028a147f42e1aa29abd7c22d00f9 Aug 07 22:49:26.999409 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Name: tempest-AttachVolumeTestJSON-209546250 Aug 07 22:49:26.999409 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Role: reader,member Aug 07 22:49:26.999409 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Roles: reader,member Aug 07 22:49:27.001114 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dd66028a147f42e1aa29abd7c22d00f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dd66028a147f42e1aa29abd7c22d00f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dd66028a147f42e1aa29abd7c22d00f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dd66028a147f42e1aa29abd7c22d00f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:49:27.001114 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant: tempest-AttachVolumeTestJSON-209546250 Aug 07 22:49:27.001114 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Id: dd66028a147f42e1aa29abd7c22d00f9 Aug 07 22:49:27.001114 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Name: tempest-AttachVolumeTestJSON-209546250 Aug 07 22:49:27.001114 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User: tempest-AttachVolumeTestJSON-209546250-project Aug 07 22:49:27.001114 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Id: default Aug 07 22:49:27.001114 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Name: Default Aug 07 22:49:27.001114 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Id: 990056333138468c99292c3f00605e6c Aug 07 22:49:27.001114 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Name: tempest-AttachVolumeTestJSON-209546250-project Aug 07 22:49:27.001114 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: method: > Aug 07 22:49:27.001114 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: exception: Instance 3243af5d-9b7f-4839-9877-cf6edb147c8b could not be found. Aug 07 22:49:27.001114 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: action_args: {'id': '3243af5d-9b7f-4839-9877-cf6edb147c8b'} Aug 07 22:49:27.002028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:49:27.002028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:49:27.002028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:49:27.002028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:49:27.002028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:49:27.002028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:49:27.002028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:49:27.002028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:49:27.002028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:49:27.002028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:49:27.002028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3243af5d-9b7f-4839-9877-cf6edb147c8b could not be found. Aug 07 22:49:27.002028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:49:27.002028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:49:27.002028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:49:27.002028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:49:27.002028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:49:27.002028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:49:27.002028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:49:27.002028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:49:27.002028 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:49:27.003299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:49:27.003299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 22:49:27.003299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 22:49:27.003299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 22:49:27.003299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 22:49:27.003299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:49:27.003299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:49:27.003299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:49:27.003299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:49:27.003299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3243af5d-9b7f-4839-9877-cf6edb147c8b could not be found. Aug 07 22:49:27.003299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:49:27.003299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:49:27.003299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:49:27.003299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:49:27.003299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:49:27.003299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:49:27.003299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:49:27.003299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:49:27.003299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3243af5d-9b7f-4839-9877-cf6edb147c8b could not be found. Aug 07 22:49:27.003299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:49:27.004619 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ad2c3272-8c5c-4db6-868a-4c62ff93d19f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Returning 404 to user: Instance 3243af5d-9b7f-4839-9877-cf6edb147c8b could not be found. {{(pid=129965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:49:27.004619 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-ad2c3272-8c5c-4db6-868a-4c62ff93d19f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 404 len: 111 microversion: 2.1 time: 0.029794 Aug 07 22:49:27.004619 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 490/1000] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:49:26 2022] DELETE /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:49:27.009851 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-1b61eb70-040d-46fd-bdb1-57ecaef0a62f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:27.010461 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-1b61eb70-040d-46fd-bdb1-57ecaef0a62f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] [instance: 3243af5d-9b7f-4839-9877-cf6edb147c8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:27.017781 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1b61eb70-040d-46fd-bdb1-57ecaef0a62f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:27.018258 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1b61eb70-040d-46fd-bdb1-57ecaef0a62f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:27.018691 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1b61eb70-040d-46fd-bdb1-57ecaef0a62f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:27.019371 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1b61eb70-040d-46fd-bdb1-57ecaef0a62f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:27.019821 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1b61eb70-040d-46fd-bdb1-57ecaef0a62f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:27.020271 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1b61eb70-040d-46fd-bdb1-57ecaef0a62f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:27.033806 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-1b61eb70-040d-46fd-bdb1-57ecaef0a62f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] HTTP exception thrown: Instance 3243af5d-9b7f-4839-9877-cf6edb147c8b could not be found. Aug 07 22:49:27.035304 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-1b61eb70-040d-46fd-bdb1-57ecaef0a62f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Request method failure captured: Aug 07 22:49:27.035304 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b HTTP/1.1 Aug 07 22:49:27.035304 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:49:27.035304 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:49:27.035304 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:49:27.035304 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:49:27.035304 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:49:27.035304 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:49:27.035304 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:49:27.035304 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:49:27.035304 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8EB1dUYsBPce-qUgdyzouxxiPwXLhFmQ622zM7d_DY6IAOwVwk2k1UVunNiTbS8jXHlj-b6Re9GcDYS6W8mOqCGd4WfZoUCThkWNdhfhobgHXXSVTwgd5KyDzd9MGoY4ljapEHDIYgKK4L0eG097UTU5PC-61wsSMlwlp5AHNclHUhk Aug 07 22:49:27.035304 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:49:27.035304 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:49:27.035304 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:49:27.035304 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:49:27.035304 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:49:27.035304 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:49:27.035304 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: dd66028a147f42e1aa29abd7c22d00f9 Aug 07 22:49:27.035304 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-AttachVolumeTestJSON-209546250 Aug 07 22:49:27.035304 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:49:27.035304 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:49:27.036939 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dd66028a147f42e1aa29abd7c22d00f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dd66028a147f42e1aa29abd7c22d00f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dd66028a147f42e1aa29abd7c22d00f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dd66028a147f42e1aa29abd7c22d00f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:49:27.036939 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-AttachVolumeTestJSON-209546250 Aug 07 22:49:27.036939 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: dd66028a147f42e1aa29abd7c22d00f9 Aug 07 22:49:27.036939 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-AttachVolumeTestJSON-209546250 Aug 07 22:49:27.036939 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-AttachVolumeTestJSON-209546250-project Aug 07 22:49:27.036939 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:49:27.036939 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:49:27.036939 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: 990056333138468c99292c3f00605e6c Aug 07 22:49:27.036939 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-AttachVolumeTestJSON-209546250-project Aug 07 22:49:27.036939 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: > Aug 07 22:49:27.036939 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Instance 3243af5d-9b7f-4839-9877-cf6edb147c8b could not be found. Aug 07 22:49:27.036939 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': '3243af5d-9b7f-4839-9877-cf6edb147c8b'} Aug 07 22:49:27.037748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:49:27.037748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:49:27.037748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:49:27.037748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:49:27.037748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:49:27.037748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:49:27.037748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:49:27.037748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:49:27.037748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:49:27.037748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:49:27.037748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3243af5d-9b7f-4839-9877-cf6edb147c8b could not be found. Aug 07 22:49:27.037748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:49:27.037748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:49:27.037748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:49:27.037748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:49:27.037748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:49:27.037748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:49:27.037748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:49:27.037748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:49:27.037748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:49:27.038996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:49:27.038996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:49:27.038996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:49:27.038996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:49:27.038996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:49:27.038996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:49:27.038996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:49:27.038996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3243af5d-9b7f-4839-9877-cf6edb147c8b could not be found. Aug 07 22:49:27.038996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:49:27.038996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:49:27.038996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:49:27.038996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:49:27.038996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:49:27.038996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:49:27.038996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:49:27.038996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:49:27.038996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3243af5d-9b7f-4839-9877-cf6edb147c8b could not be found. Aug 07 22:49:27.038996 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:49:27.040792 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-1b61eb70-040d-46fd-bdb1-57ecaef0a62f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] Returning 404 to user: Instance 3243af5d-9b7f-4839-9877-cf6edb147c8b could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:49:27.040792 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-1b61eb70-040d-46fd-bdb1-57ecaef0a62f tempest-AttachVolumeTestJSON-209546250 tempest-AttachVolumeTestJSON-209546250-project] 10.222.0.30 "GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b" status: 404 len: 111 microversion: 2.1 time: 0.031258 Aug 07 22:49:27.040792 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 511/1001] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:49:27 2022] GET /compute/v2.1/servers/3243af5d-9b7f-4839-9877-cf6edb147c8b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:49:37.596633 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:49:37.598520 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:49:37.724583 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-795bfe7f-f02e-4d50-973d-72faab641215 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Action: 'create', calling method: .version_select at 0x7fc0ac9b1c10>, body: {"keypair": {"name": "tempest-keypair-2039379767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKuwikt27boWoERnhfq768eg68fnZiYTyVyxhZGpmQGnbE8HU3552eJK+K0+2h7cr4deDz8I8vmeB2HIry5KWjWHq3hXD6jVUbYm7bLo6xXjafDCAN0YHZ55olkTVgs7g=="}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:49:37.747291 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-795bfe7f-f02e-4d50-973d-72faab641215 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Getting quotas for project 4571d38eeff749fcb073842d5ad4fc65. Resources: {'key_pairs'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:49:37.747496 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-795bfe7f-f02e-4d50-973d-72faab641215 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Getting quotas for user 13c06492c8db44759185686bd0a11a57 and project 4571d38eeff749fcb073842d5ad4fc65. Resources: {'key_pairs'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:49:37.855578 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-795bfe7f-f02e-4d50-973d-72faab641215 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.270691 Aug 07 22:49:37.856270 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 491/1002] 10.222.0.30 () {60 vars in 1159 bytes} [Sun Aug 7 22:49:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:49:40.079683 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-0571ff04-d1cb-4b90-a910-9758a0da05ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-220676789", "imageRef": "91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d15b754-28f9-4d07-a0c7-ae4f93625ddd"}], "security_groups": [{"name": "tempest-securitygroup--220024806"}], "key_name": "tempest-keypair-2039379767", "user_data": "}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:49:40.218405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.network.neutron [None req-0571ff04-d1cb-4b90-a910-9758a0da05ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] validate_networks() for [('2d15b754-28f9-4d07-a0c7-ae4f93625ddd', None, None, None, None, None)] {{(pid=129964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 22:49:40.938863 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-0571ff04-d1cb-4b90-a910-9758a0da05ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Flavor limits 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 22:49:40.939284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-0571ff04-d1cb-4b90-a910-9758a0da05ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Image limits 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 22:49:40.939756 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-0571ff04-d1cb-4b90-a910-9758a0da05ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Flavor pref 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 22:49:40.946665 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-0571ff04-d1cb-4b90-a910-9758a0da05ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Image pref 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 22:49:40.946665 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-0571ff04-d1cb-4b90-a910-9758a0da05ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 22:49:40.950886 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0571ff04-d1cb-4b90-a910-9758a0da05ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:40.951470 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0571ff04-d1cb-4b90-a910-9758a0da05ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:40.951990 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0571ff04-d1cb-4b90-a910-9758a0da05ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:40.952821 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0571ff04-d1cb-4b90-a910-9758a0da05ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:40.953378 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0571ff04-d1cb-4b90-a910-9758a0da05ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:40.953803 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0571ff04-d1cb-4b90-a910-9758a0da05ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:40.972653 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-0571ff04-d1cb-4b90-a910-9758a0da05ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Getting quotas for project 4571d38eeff749fcb073842d5ad4fc65. Resources: {'cores', 'instances', 'ram'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:49:40.976640 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-0571ff04-d1cb-4b90-a910-9758a0da05ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Getting quotas for user 13c06492c8db44759185686bd0a11a57 and project 4571d38eeff749fcb073842d5ad4fc65. Resources: {'cores', 'instances', 'ram'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:49:40.988549 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-0571ff04-d1cb-4b90-a910-9758a0da05ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Going to run 1 instances... {{(pid=129964) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 22:49:40.990824 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-0571ff04-d1cb-4b90-a910-9758a0da05ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 22:49:41.122982 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-0571ff04-d1cb-4b90-a910-9758a0da05ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.047637 Aug 07 22:49:41.123664 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 512/1003] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 22:49:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 22:49:41.135033 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-c7a59b41-17bb-42d1-9f97-9a08f0e689f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:41.135652 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-c7a59b41-17bb-42d1-9f97-9a08f0e689f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:41.190873 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-c7a59b41-17bb-42d1-9f97-9a08f0e689f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:49:41.197962 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-c7a59b41-17bb-42d1-9f97-9a08f0e689f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d" status: 200 len: 1241 microversion: 2.1 time: 0.067441 Aug 07 22:49:41.198531 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 492/1004] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:49:41 2022] GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:49:42.219340 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b2eeb310-6624-4cef-8069-8f1491f271cd tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:42.219948 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-b2eeb310-6624-4cef-8069-8f1491f271cd tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:42.273526 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-b2eeb310-6624-4cef-8069-8f1491f271cd tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:49:42.280672 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-b2eeb310-6624-4cef-8069-8f1491f271cd tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d" status: 200 len: 1241 microversion: 2.1 time: 0.065943 Aug 07 22:49:42.281244 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 513/1005] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:49:42 2022] GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:49:43.302047 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-124a503e-346f-4cbd-9a3d-91de5fd56525 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:43.302660 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-124a503e-346f-4cbd-9a3d-91de5fd56525 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:43.310217 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-124a503e-346f-4cbd-9a3d-91de5fd56525 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:43.310703 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-124a503e-346f-4cbd-9a3d-91de5fd56525 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:43.311142 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-124a503e-346f-4cbd-9a3d-91de5fd56525 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:43.311841 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-124a503e-346f-4cbd-9a3d-91de5fd56525 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:43.312320 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-124a503e-346f-4cbd-9a3d-91de5fd56525 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:43.312747 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-124a503e-346f-4cbd-9a3d-91de5fd56525 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:43.379736 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-124a503e-346f-4cbd-9a3d-91de5fd56525 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:49:43.387921 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-124a503e-346f-4cbd-9a3d-91de5fd56525 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d" status: 200 len: 1293 microversion: 2.1 time: 0.089873 Aug 07 22:49:43.388597 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 493/1006] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:49:43 2022] GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:49:44.409205 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-fdfb48e0-d71b-4547-9f71-d34251cff7df tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:44.409828 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-fdfb48e0-d71b-4547-9f71-d34251cff7df tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:44.417383 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fdfb48e0-d71b-4547-9f71-d34251cff7df tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:44.418149 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fdfb48e0-d71b-4547-9f71-d34251cff7df tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:44.418581 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fdfb48e0-d71b-4547-9f71-d34251cff7df tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:44.419289 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fdfb48e0-d71b-4547-9f71-d34251cff7df tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:44.419736 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fdfb48e0-d71b-4547-9f71-d34251cff7df tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:44.420429 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-fdfb48e0-d71b-4547-9f71-d34251cff7df tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:44.561264 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-fdfb48e0-d71b-4547-9f71-d34251cff7df tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:49:44.568700 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-fdfb48e0-d71b-4547-9f71-d34251cff7df tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d" status: 200 len: 1366 microversion: 2.1 time: 0.163496 Aug 07 22:49:44.580286 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 514/1007] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:49:44 2022] GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:49:45.276334 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-163c8d2e-6ffa-45e6-9c07-28f709d6b0c7 req-793f9469-c5ea-4aa5-8b07-4546bb7b70d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5d89236-5cd5-455e-896a-82d335ebf25d", "tag": "f4601a76-699b-47b3-bb55-443dcd606371"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:49:45.286976 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-163c8d2e-6ffa-45e6-9c07-28f709d6b0c7 req-793f9469-c5ea-4aa5-8b07-4546bb7b70d1 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:45.287503 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-163c8d2e-6ffa-45e6-9c07-28f709d6b0c7 req-793f9469-c5ea-4aa5-8b07-4546bb7b70d1 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:45.287952 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-163c8d2e-6ffa-45e6-9c07-28f709d6b0c7 req-793f9469-c5ea-4aa5-8b07-4546bb7b70d1 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:45.299066 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-163c8d2e-6ffa-45e6-9c07-28f709d6b0c7 req-793f9469-c5ea-4aa5-8b07-4546bb7b70d1 service nova] Creating event network-changed:f4601a76-699b-47b3-bb55-443dcd606371 for instance a5d89236-5cd5-455e-896a-82d335ebf25d on hv-cinder-85032 Aug 07 22:49:45.304247 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-163c8d2e-6ffa-45e6-9c07-28f709d6b0c7 req-793f9469-c5ea-4aa5-8b07-4546bb7b70d1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031793 Aug 07 22:49:45.304860 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 494/1008] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:49:45.590153 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-926a30f4-0b3e-4ffa-af82-4bccac941e10 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:45.590772 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-926a30f4-0b3e-4ffa-af82-4bccac941e10 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:45.598550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-926a30f4-0b3e-4ffa-af82-4bccac941e10 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:45.599041 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-926a30f4-0b3e-4ffa-af82-4bccac941e10 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:45.599483 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-926a30f4-0b3e-4ffa-af82-4bccac941e10 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:45.600210 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-926a30f4-0b3e-4ffa-af82-4bccac941e10 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:45.600667 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-926a30f4-0b3e-4ffa-af82-4bccac941e10 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:45.601096 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-926a30f4-0b3e-4ffa-af82-4bccac941e10 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:45.735040 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-926a30f4-0b3e-4ffa-af82-4bccac941e10 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:49:45.743088 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-926a30f4-0b3e-4ffa-af82-4bccac941e10 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d" status: 200 len: 1366 microversion: 2.1 time: 0.157117 Aug 07 22:49:45.743672 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 515/1009] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:49:45 2022] GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:49:46.764762 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-0be03005-0687-43d7-9e81-53acb02b29cb tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:46.765492 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-0be03005-0687-43d7-9e81-53acb02b29cb tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:46.771554 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0be03005-0687-43d7-9e81-53acb02b29cb tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:46.772058 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0be03005-0687-43d7-9e81-53acb02b29cb tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:46.772502 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0be03005-0687-43d7-9e81-53acb02b29cb tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:46.773190 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0be03005-0687-43d7-9e81-53acb02b29cb tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:46.773647 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0be03005-0687-43d7-9e81-53acb02b29cb tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:46.774098 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0be03005-0687-43d7-9e81-53acb02b29cb tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:46.905843 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-0be03005-0687-43d7-9e81-53acb02b29cb tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:49:46.913113 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-0be03005-0687-43d7-9e81-53acb02b29cb tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d" status: 200 len: 1366 microversion: 2.1 time: 0.153293 Aug 07 22:49:46.913663 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 495/1010] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:49:46 2022] GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:49:47.935130 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-022058a5-1ecd-44ae-973b-4dde5d7b070f tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:47.935748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-022058a5-1ecd-44ae-973b-4dde5d7b070f tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:47.942381 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-022058a5-1ecd-44ae-973b-4dde5d7b070f tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:47.942872 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-022058a5-1ecd-44ae-973b-4dde5d7b070f tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:47.943311 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-022058a5-1ecd-44ae-973b-4dde5d7b070f tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:47.944037 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-022058a5-1ecd-44ae-973b-4dde5d7b070f tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:47.944531 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-022058a5-1ecd-44ae-973b-4dde5d7b070f tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:47.944928 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-022058a5-1ecd-44ae-973b-4dde5d7b070f tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:48.073340 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-022058a5-1ecd-44ae-973b-4dde5d7b070f tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:49:48.080964 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-022058a5-1ecd-44ae-973b-4dde5d7b070f tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d" status: 200 len: 1366 microversion: 2.1 time: 0.149764 Aug 07 22:49:48.081534 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 516/1011] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:49:47 2022] GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:49:49.100770 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ce319f2c-55eb-40ba-a825-0ebe09b587ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:49.101386 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-ce319f2c-55eb-40ba-a825-0ebe09b587ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:49.108590 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ce319f2c-55eb-40ba-a825-0ebe09b587ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:49.109070 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ce319f2c-55eb-40ba-a825-0ebe09b587ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:49.109508 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ce319f2c-55eb-40ba-a825-0ebe09b587ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:49.110198 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ce319f2c-55eb-40ba-a825-0ebe09b587ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:49.110653 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ce319f2c-55eb-40ba-a825-0ebe09b587ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:49.111079 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ce319f2c-55eb-40ba-a825-0ebe09b587ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:49.243608 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-ce319f2c-55eb-40ba-a825-0ebe09b587ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:49:49.250975 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-ce319f2c-55eb-40ba-a825-0ebe09b587ad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d" status: 200 len: 1366 microversion: 2.1 time: 0.154090 Aug 07 22:49:49.253048 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 496/1012] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:49:49 2022] GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:49:50.271406 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-3bca87ff-a732-47fe-99f5-0c3916a74e02 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:50.272289 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-3bca87ff-a732-47fe-99f5-0c3916a74e02 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:50.279476 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3bca87ff-a732-47fe-99f5-0c3916a74e02 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:50.279959 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3bca87ff-a732-47fe-99f5-0c3916a74e02 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:50.280446 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3bca87ff-a732-47fe-99f5-0c3916a74e02 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:50.281136 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3bca87ff-a732-47fe-99f5-0c3916a74e02 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:50.281589 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3bca87ff-a732-47fe-99f5-0c3916a74e02 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:50.282013 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3bca87ff-a732-47fe-99f5-0c3916a74e02 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:50.409254 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-3bca87ff-a732-47fe-99f5-0c3916a74e02 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:49:50.416724 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-3bca87ff-a732-47fe-99f5-0c3916a74e02 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d" status: 200 len: 1366 microversion: 2.1 time: 0.149225 Aug 07 22:49:50.417292 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 517/1013] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:49:50 2022] GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:49:51.444315 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-39022d5a-5886-419d-9496-a96b0f3cb335 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:51.444971 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-39022d5a-5886-419d-9496-a96b0f3cb335 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:51.447519 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=6 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:49:51.452343 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-39022d5a-5886-419d-9496-a96b0f3cb335 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:51.452826 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-39022d5a-5886-419d-9496-a96b0f3cb335 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:51.453265 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-39022d5a-5886-419d-9496-a96b0f3cb335 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:51.453952 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-39022d5a-5886-419d-9496-a96b0f3cb335 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:51.454403 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-39022d5a-5886-419d-9496-a96b0f3cb335 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:51.454826 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-39022d5a-5886-419d-9496-a96b0f3cb335 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:51.585649 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-39022d5a-5886-419d-9496-a96b0f3cb335 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:49:51.593956 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-39022d5a-5886-419d-9496-a96b0f3cb335 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d" status: 200 len: 1366 microversion: 2.1 time: 0.153614 Aug 07 22:49:51.594524 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 497/1014] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:49:51 2022] GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:49:51.759892 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=2 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:49:51.819497 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-a6747f77-faa2-4b98-94d4-df5d8060544c req-c3b1b831-50ee-4be9-9d3e-080161d29f83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5d89236-5cd5-455e-896a-82d335ebf25d", "name": "network-vif-plugged", "status": "completed", "tag": "f4601a76-699b-47b3-bb55-443dcd606371"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:49:51.829395 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-a6747f77-faa2-4b98-94d4-df5d8060544c req-c3b1b831-50ee-4be9-9d3e-080161d29f83 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:51.830083 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-a6747f77-faa2-4b98-94d4-df5d8060544c req-c3b1b831-50ee-4be9-9d3e-080161d29f83 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:51.830507 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-a6747f77-faa2-4b98-94d4-df5d8060544c req-c3b1b831-50ee-4be9-9d3e-080161d29f83 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:51.841858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-a6747f77-faa2-4b98-94d4-df5d8060544c req-c3b1b831-50ee-4be9-9d3e-080161d29f83 service nova] Creating event network-vif-plugged:f4601a76-699b-47b3-bb55-443dcd606371 for instance a5d89236-5cd5-455e-896a-82d335ebf25d on hv-cinder-85032 Aug 07 22:49:51.847375 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-a6747f77-faa2-4b98-94d4-df5d8060544c req-c3b1b831-50ee-4be9-9d3e-080161d29f83 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092491 Aug 07 22:49:51.847959 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 518/1015] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:49:52.614914 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-b29aa076-c6ec-4fc3-98f4-1a7fa740724e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:52.615709 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-b29aa076-c6ec-4fc3-98f4-1a7fa740724e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:52.622830 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b29aa076-c6ec-4fc3-98f4-1a7fa740724e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:52.623299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b29aa076-c6ec-4fc3-98f4-1a7fa740724e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:52.623727 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b29aa076-c6ec-4fc3-98f4-1a7fa740724e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:52.624430 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b29aa076-c6ec-4fc3-98f4-1a7fa740724e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:52.624876 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b29aa076-c6ec-4fc3-98f4-1a7fa740724e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:52.625351 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b29aa076-c6ec-4fc3-98f4-1a7fa740724e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:52.756414 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-b29aa076-c6ec-4fc3-98f4-1a7fa740724e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:49:52.764713 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-b29aa076-c6ec-4fc3-98f4-1a7fa740724e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d" status: 200 len: 1366 microversion: 2.1 time: 0.153325 Aug 07 22:49:52.765274 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 498/1016] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:49:52 2022] GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:49:53.786544 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-56c6ee0c-1125-48aa-9643-132a1d489a01 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:53.787234 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-56c6ee0c-1125-48aa-9643-132a1d489a01 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:53.789257 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=8 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:49:53.794786 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-56c6ee0c-1125-48aa-9643-132a1d489a01 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:53.795259 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-56c6ee0c-1125-48aa-9643-132a1d489a01 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:53.795690 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-56c6ee0c-1125-48aa-9643-132a1d489a01 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:53.796403 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-56c6ee0c-1125-48aa-9643-132a1d489a01 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:53.796851 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-56c6ee0c-1125-48aa-9643-132a1d489a01 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:53.797632 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-56c6ee0c-1125-48aa-9643-132a1d489a01 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:53.933032 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-56c6ee0c-1125-48aa-9643-132a1d489a01 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:49:53.940572 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-56c6ee0c-1125-48aa-9643-132a1d489a01 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d" status: 200 len: 1366 microversion: 2.1 time: 0.158605 Aug 07 22:49:53.941859 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 519/1017] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:49:53 2022] GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:49:54.961695 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-5c285c5b-454a-4e93-b737-874a6afe26f2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:54.962305 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-5c285c5b-454a-4e93-b737-874a6afe26f2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:54.969299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5c285c5b-454a-4e93-b737-874a6afe26f2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:54.969771 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5c285c5b-454a-4e93-b737-874a6afe26f2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:54.970202 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5c285c5b-454a-4e93-b737-874a6afe26f2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:54.970878 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5c285c5b-454a-4e93-b737-874a6afe26f2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:54.971324 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5c285c5b-454a-4e93-b737-874a6afe26f2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:54.971740 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5c285c5b-454a-4e93-b737-874a6afe26f2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:55.103740 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-5c285c5b-454a-4e93-b737-874a6afe26f2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:49:55.111125 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-5c285c5b-454a-4e93-b737-874a6afe26f2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d" status: 200 len: 1555 microversion: 2.1 time: 0.153332 Aug 07 22:49:55.111686 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 499/1018] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:49:54 2022] GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:49:55.131367 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-716d234c-5c0d-47a5-8fcb-58650845d90c tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:49:55.131866 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-716d234c-5c0d-47a5-8fcb-58650845d90c tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:49:55.139153 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-716d234c-5c0d-47a5-8fcb-58650845d90c tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:55.139927 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-716d234c-5c0d-47a5-8fcb-58650845d90c tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:55.140485 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-716d234c-5c0d-47a5-8fcb-58650845d90c tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:55.141157 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-716d234c-5c0d-47a5-8fcb-58650845d90c tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:55.141614 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-716d234c-5c0d-47a5-8fcb-58650845d90c tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:55.142039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-716d234c-5c0d-47a5-8fcb-58650845d90c tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:55.217639 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-716d234c-5c0d-47a5-8fcb-58650845d90c tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090106 Aug 07 22:49:55.218236 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 520/1019] 10.222.0.30 () {58 vars in 1275 bytes} [Sun Aug 7 22:49:55 2022] GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:49:56.233472 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-7750860f-735a-4cb4-9c63-7fdaa90b2020 req-38910132-ec72-4520-832e-0041e8d9d09e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5d89236-5cd5-455e-896a-82d335ebf25d", "tag": "f4601a76-699b-47b3-bb55-443dcd606371"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:49:56.243354 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-7750860f-735a-4cb4-9c63-7fdaa90b2020 req-38910132-ec72-4520-832e-0041e8d9d09e service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:49:56.244516 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-7750860f-735a-4cb4-9c63-7fdaa90b2020 req-38910132-ec72-4520-832e-0041e8d9d09e service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:49:56.245017 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-7750860f-735a-4cb4-9c63-7fdaa90b2020 req-38910132-ec72-4520-832e-0041e8d9d09e service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:49:56.255736 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-7750860f-735a-4cb4-9c63-7fdaa90b2020 req-38910132-ec72-4520-832e-0041e8d9d09e service nova] Creating event network-changed:f4601a76-699b-47b3-bb55-443dcd606371 for instance a5d89236-5cd5-455e-896a-82d335ebf25d on hv-cinder-85032 Aug 07 22:49:56.260970 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-7750860f-735a-4cb4-9c63-7fdaa90b2020 req-38910132-ec72-4520-832e-0041e8d9d09e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032603 Aug 07 22:49:56.261592 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 500/1020] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:50:32.029612 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:50:32.030371 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=41 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:50:32.034383 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-c04c150b-d32b-4aab-8d53-27a721f9dc8f tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:50:32.034872 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-c04c150b-d32b-4aab-8d53-27a721f9dc8f tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:50:32.041182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c04c150b-d32b-4aab-8d53-27a721f9dc8f tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:50:32.041665 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c04c150b-d32b-4aab-8d53-27a721f9dc8f tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:50:32.042103 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c04c150b-d32b-4aab-8d53-27a721f9dc8f tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:50:32.042834 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c04c150b-d32b-4aab-8d53-27a721f9dc8f tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:50:32.043288 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c04c150b-d32b-4aab-8d53-27a721f9dc8f tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:50:32.043734 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c04c150b-d32b-4aab-8d53-27a721f9dc8f tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:50:32.070170 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-c04c150b-d32b-4aab-8d53-27a721f9dc8f tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d/ips" status: 200 len: 149 microversion: 2.1 time: 0.042009 Aug 07 22:50:32.070797 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 521/1021] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Aug 7 22:50:32 2022] GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:50:33.729749 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:50:33.730579 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=40 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:50:33.735770 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-71848ece-5b53-4954-82ee-073975db6c18 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4726885-5682-46ee-b1a4-cee5e2bc63ab"}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:50:33.738228 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-71848ece-5b53-4954-82ee-073975db6c18 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:50:33.744174 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-71848ece-5b53-4954-82ee-073975db6c18 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:50:33.746025 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-71848ece-5b53-4954-82ee-073975db6c18 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:50:33.746025 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-71848ece-5b53-4954-82ee-073975db6c18 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:50:33.746025 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-71848ece-5b53-4954-82ee-073975db6c18 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:50:33.746295 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-71848ece-5b53-4954-82ee-073975db6c18 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:50:33.746584 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-71848ece-5b53-4954-82ee-073975db6c18 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:50:34.413068 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-71848ece-5b53-4954-82ee-073975db6c18 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "POST /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.684789 Aug 07 22:50:34.413701 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 501/1022] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 22:50:33 2022] POST /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d/os-volume_attachments => generated 194 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:50:41.934297 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-da5a4b52-c330-412d-bd3e-1e27eb4989b0 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Action: 'create', calling method: .version_select at 0x7fc09fb130d0>, body: {"keypair": {"name": "tempest-keypair-1283328082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRCLq1Y4X0mlvjvaFXGpsIgYw7Yylzz+VZZqXLps51abcDXdzvuaZEl8ScI7nDYcYas8czG/0vLmK+igT4Zz6Xbi2CazgDCw/Jc0uwfXdtFliv6BtUs7A+AAiDIAqU7LQ=="}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:50:41.950726 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-da5a4b52-c330-412d-bd3e-1e27eb4989b0 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Getting quotas for project 4571d38eeff749fcb073842d5ad4fc65. Resources: {'key_pairs'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:50:41.955067 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-da5a4b52-c330-412d-bd3e-1e27eb4989b0 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Getting quotas for user 13c06492c8db44759185686bd0a11a57 and project 4571d38eeff749fcb073842d5ad4fc65. Resources: {'key_pairs'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:50:42.036872 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-da5a4b52-c330-412d-bd3e-1e27eb4989b0 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.106511 Aug 07 22:50:42.037535 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 522/1023] 10.222.0.30 () {60 vars in 1159 bytes} [Sun Aug 7 22:50:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:50:44.055280 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=2 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:50:44.059966 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-b24bb4c3-bdbc-4a30-8d12-9b35e4fd0768 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1867736269", "imageRef": "91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d15b754-28f9-4d07-a0c7-ae4f93625ddd"}], "security_groups": [{"name": "tempest-securitygroup--1000722161"}], "key_name": "tempest-keypair-1283328082", "user_data": "}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:50:44.164981 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.network.neutron [None req-b24bb4c3-bdbc-4a30-8d12-9b35e4fd0768 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] validate_networks() for [('2d15b754-28f9-4d07-a0c7-ae4f93625ddd', None, None, None, None, None)] {{(pid=129965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 22:50:44.316640 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:50:44.590649 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-b24bb4c3-bdbc-4a30-8d12-9b35e4fd0768 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Flavor limits 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 22:50:44.591068 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-b24bb4c3-bdbc-4a30-8d12-9b35e4fd0768 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Image limits 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 22:50:44.591539 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-b24bb4c3-bdbc-4a30-8d12-9b35e4fd0768 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Flavor pref 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 22:50:44.591939 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-b24bb4c3-bdbc-4a30-8d12-9b35e4fd0768 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Image pref 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 22:50:44.592422 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-b24bb4c3-bdbc-4a30-8d12-9b35e4fd0768 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 22:50:44.602089 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b24bb4c3-bdbc-4a30-8d12-9b35e4fd0768 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:50:44.602571 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b24bb4c3-bdbc-4a30-8d12-9b35e4fd0768 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:50:44.603011 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b24bb4c3-bdbc-4a30-8d12-9b35e4fd0768 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:50:44.603809 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b24bb4c3-bdbc-4a30-8d12-9b35e4fd0768 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:50:44.604287 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b24bb4c3-bdbc-4a30-8d12-9b35e4fd0768 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:50:44.604717 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b24bb4c3-bdbc-4a30-8d12-9b35e4fd0768 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:50:44.622382 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-b24bb4c3-bdbc-4a30-8d12-9b35e4fd0768 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Getting quotas for project 4571d38eeff749fcb073842d5ad4fc65. Resources: {'cores', 'instances', 'ram'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:50:44.626444 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-b24bb4c3-bdbc-4a30-8d12-9b35e4fd0768 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Getting quotas for user 13c06492c8db44759185686bd0a11a57 and project 4571d38eeff749fcb073842d5ad4fc65. Resources: {'cores', 'instances', 'ram'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:50:44.637594 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-b24bb4c3-bdbc-4a30-8d12-9b35e4fd0768 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Going to run 1 instances... {{(pid=129965) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 22:50:44.643579 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-b24bb4c3-bdbc-4a30-8d12-9b35e4fd0768 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 22:50:44.762524 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b24bb4c3-bdbc-4a30-8d12-9b35e4fd0768 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [7d281c7d-8068-4169-b953-57a146263e2b] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 07 22:50:45.771902 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO oslo.messaging._drivers.impl_rabbit [None req-b24bb4c3-bdbc-4a30-8d12-9b35e4fd0768 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [7d281c7d-8068-4169-b953-57a146263e2b] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 56550. Aug 07 22:50:45.777692 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-b24bb4c3-bdbc-4a30-8d12-9b35e4fd0768 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.722447 Aug 07 22:50:45.777692 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 502/1024] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 22:50:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 1724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 22:50:45.788589 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-9808b367-7bf3-4f7f-8294-29c96fc689ee tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:50:45.789322 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-9808b367-7bf3-4f7f-8294-29c96fc689ee tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:50:45.841863 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-9808b367-7bf3-4f7f-8294-29c96fc689ee tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:50:45.850012 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-9808b367-7bf3-4f7f-8294-29c96fc689ee tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6" status: 200 len: 1242 microversion: 2.1 time: 0.065350 Aug 07 22:50:45.851985 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 523/1025] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:50:45 2022] GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:50:46.871059 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-f95a420e-6a4c-4c21-a48a-5a77d0de98e2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:50:46.871669 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-f95a420e-6a4c-4c21-a48a-5a77d0de98e2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:50:46.923896 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-f95a420e-6a4c-4c21-a48a-5a77d0de98e2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:50:46.930467 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-f95a420e-6a4c-4c21-a48a-5a77d0de98e2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6" status: 200 len: 1242 microversion: 2.1 time: 0.063781 Aug 07 22:50:46.931026 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 503/1026] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:50:46 2022] GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6 => generated 1242 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:50:47.950653 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-810fb117-f1b0-4db3-86a3-c0cd1632121c tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:50:47.951264 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-810fb117-f1b0-4db3-86a3-c0cd1632121c tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:50:48.003756 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-810fb117-f1b0-4db3-86a3-c0cd1632121c tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:50:48.010752 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-810fb117-f1b0-4db3-86a3-c0cd1632121c tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6" status: 200 len: 1242 microversion: 2.1 time: 0.063880 Aug 07 22:50:48.011308 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 524/1027] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:50:47 2022] GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6 => generated 1242 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:50:49.032499 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-abd76421-989a-4fa3-8dd9-a6d254d2a9b0 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:50:49.033116 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-abd76421-989a-4fa3-8dd9-a6d254d2a9b0 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:50:49.088179 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-abd76421-989a-4fa3-8dd9-a6d254d2a9b0 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:50:49.095444 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-abd76421-989a-4fa3-8dd9-a6d254d2a9b0 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6" status: 200 len: 1242 microversion: 2.1 time: 0.067722 Aug 07 22:50:49.096008 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 504/1028] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:50:49 2022] GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:50:50.116337 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-151c8b35-6b87-4dd2-8b4f-d5c388e7b35b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:50:50.117011 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-151c8b35-6b87-4dd2-8b4f-d5c388e7b35b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:50:50.124097 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-151c8b35-6b87-4dd2-8b4f-d5c388e7b35b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:50:50.125167 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-151c8b35-6b87-4dd2-8b4f-d5c388e7b35b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:50:50.125948 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-151c8b35-6b87-4dd2-8b4f-d5c388e7b35b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:50:50.126658 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-151c8b35-6b87-4dd2-8b4f-d5c388e7b35b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:50:50.127118 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-151c8b35-6b87-4dd2-8b4f-d5c388e7b35b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:50:50.127548 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-151c8b35-6b87-4dd2-8b4f-d5c388e7b35b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:50:50.189469 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-151c8b35-6b87-4dd2-8b4f-d5c388e7b35b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:50:50.197229 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-151c8b35-6b87-4dd2-8b4f-d5c388e7b35b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6" status: 200 len: 1246 microversion: 2.1 time: 0.084764 Aug 07 22:50:50.197734 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 525/1029] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:50:50 2022] GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:50:51.218591 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-1bb9d0cb-496b-4dbd-9217-7283248483de tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:50:51.219335 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-1bb9d0cb-496b-4dbd-9217-7283248483de tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:50:51.226080 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1bb9d0cb-496b-4dbd-9217-7283248483de tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:50:51.227540 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1bb9d0cb-496b-4dbd-9217-7283248483de tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:50:51.227540 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1bb9d0cb-496b-4dbd-9217-7283248483de tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:50:51.227766 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1bb9d0cb-496b-4dbd-9217-7283248483de tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:50:51.228165 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1bb9d0cb-496b-4dbd-9217-7283248483de tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:50:51.228586 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1bb9d0cb-496b-4dbd-9217-7283248483de tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:50:51.290822 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-1bb9d0cb-496b-4dbd-9217-7283248483de tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:50:51.298975 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-1bb9d0cb-496b-4dbd-9217-7283248483de tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6" status: 200 len: 1294 microversion: 2.1 time: 0.084866 Aug 07 22:50:51.299527 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 505/1030] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:50:51 2022] GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6 => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:50:52.319269 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-55d11415-b442-48e3-a1ab-03aef34d3404 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:50:52.320744 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-55d11415-b442-48e3-a1ab-03aef34d3404 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:50:52.327323 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-55d11415-b442-48e3-a1ab-03aef34d3404 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:50:52.327887 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-55d11415-b442-48e3-a1ab-03aef34d3404 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:50:52.328674 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-55d11415-b442-48e3-a1ab-03aef34d3404 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:50:52.329384 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-55d11415-b442-48e3-a1ab-03aef34d3404 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:50:52.329838 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-55d11415-b442-48e3-a1ab-03aef34d3404 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:50:52.330265 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-55d11415-b442-48e3-a1ab-03aef34d3404 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:50:52.393180 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-55d11415-b442-48e3-a1ab-03aef34d3404 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:50:52.400754 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-55d11415-b442-48e3-a1ab-03aef34d3404 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6" status: 200 len: 1300 microversion: 2.1 time: 0.085457 Aug 07 22:50:52.401404 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 526/1031] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:50:52 2022] GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6 => generated 1300 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:50:53.423997 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-a6021a6e-81e6-4e4c-bbfb-263a115f4678 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:50:53.424627 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-a6021a6e-81e6-4e4c-bbfb-263a115f4678 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:50:53.431017 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a6021a6e-81e6-4e4c-bbfb-263a115f4678 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:50:53.431488 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a6021a6e-81e6-4e4c-bbfb-263a115f4678 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:50:53.431918 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a6021a6e-81e6-4e4c-bbfb-263a115f4678 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:50:53.432657 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a6021a6e-81e6-4e4c-bbfb-263a115f4678 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:50:53.433106 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a6021a6e-81e6-4e4c-bbfb-263a115f4678 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:50:53.433521 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-a6021a6e-81e6-4e4c-bbfb-263a115f4678 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:50:53.471647 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-5a8bda2f-def1-4102-b952-dc642c3b8ee3 req-a779db36-fea0-4f4b-bd9c-ec88be01e909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cdd262a-57b5-44bd-a4e0-541425bd19c6", "tag": "20f11896-6843-482c-b04f-d3a4220c27c8"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:50:53.482222 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-5a8bda2f-def1-4102-b952-dc642c3b8ee3 req-a779db36-fea0-4f4b-bd9c-ec88be01e909 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:50:53.482714 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-5a8bda2f-def1-4102-b952-dc642c3b8ee3 req-a779db36-fea0-4f4b-bd9c-ec88be01e909 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:50:53.483217 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-5a8bda2f-def1-4102-b952-dc642c3b8ee3 req-a779db36-fea0-4f4b-bd9c-ec88be01e909 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:50:53.496236 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-5a8bda2f-def1-4102-b952-dc642c3b8ee3 req-a779db36-fea0-4f4b-bd9c-ec88be01e909 service nova] Creating event network-changed:20f11896-6843-482c-b04f-d3a4220c27c8 for instance 0cdd262a-57b5-44bd-a4e0-541425bd19c6 on hv-cinder-85032 Aug 07 22:50:53.501729 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-5a8bda2f-def1-4102-b952-dc642c3b8ee3 req-a779db36-fea0-4f4b-bd9c-ec88be01e909 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034381 Aug 07 22:50:53.502341 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 527/1032] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:50:53.573732 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-a6021a6e-81e6-4e4c-bbfb-263a115f4678 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:50:53.581838 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-a6021a6e-81e6-4e4c-bbfb-263a115f4678 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6" status: 200 len: 1368 microversion: 2.1 time: 0.162455 Aug 07 22:50:53.582399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 506/1033] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:50:53 2022] GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:50:54.603114 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-4cb85be9-6ee8-44e5-bc11-093f846ccd69 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:50:54.603812 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-4cb85be9-6ee8-44e5-bc11-093f846ccd69 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:50:54.610788 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4cb85be9-6ee8-44e5-bc11-093f846ccd69 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:50:54.611267 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4cb85be9-6ee8-44e5-bc11-093f846ccd69 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:50:54.611697 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4cb85be9-6ee8-44e5-bc11-093f846ccd69 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:50:54.612416 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4cb85be9-6ee8-44e5-bc11-093f846ccd69 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:50:54.612885 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4cb85be9-6ee8-44e5-bc11-093f846ccd69 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:50:54.613305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4cb85be9-6ee8-44e5-bc11-093f846ccd69 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:50:54.742651 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-4cb85be9-6ee8-44e5-bc11-093f846ccd69 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:50:54.750621 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-4cb85be9-6ee8-44e5-bc11-093f846ccd69 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6" status: 200 len: 1368 microversion: 2.1 time: 0.152158 Aug 07 22:50:54.751235 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 528/1034] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:50:54 2022] GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:50:55.772194 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d2ac3539-d7bd-460c-91c0-3324bf3d986a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:50:55.772813 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-d2ac3539-d7bd-460c-91c0-3324bf3d986a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:50:55.775109 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=2 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:50:55.779904 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d2ac3539-d7bd-460c-91c0-3324bf3d986a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:50:55.780460 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d2ac3539-d7bd-460c-91c0-3324bf3d986a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:50:55.780974 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d2ac3539-d7bd-460c-91c0-3324bf3d986a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:50:55.781809 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d2ac3539-d7bd-460c-91c0-3324bf3d986a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:50:55.782262 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d2ac3539-d7bd-460c-91c0-3324bf3d986a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:50:55.782687 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d2ac3539-d7bd-460c-91c0-3324bf3d986a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:50:55.916195 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-d2ac3539-d7bd-460c-91c0-3324bf3d986a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:50:55.923665 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-d2ac3539-d7bd-460c-91c0-3324bf3d986a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6" status: 200 len: 1368 microversion: 2.1 time: 0.155355 Aug 07 22:50:55.924280 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 507/1035] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:50:55 2022] GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:50:56.945116 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-3ddc6052-7394-4e7e-8524-a181b6894bd8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:50:56.945734 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-3ddc6052-7394-4e7e-8524-a181b6894bd8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:50:56.952147 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3ddc6052-7394-4e7e-8524-a181b6894bd8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:50:56.953120 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3ddc6052-7394-4e7e-8524-a181b6894bd8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:50:56.953552 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3ddc6052-7394-4e7e-8524-a181b6894bd8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:50:56.954233 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3ddc6052-7394-4e7e-8524-a181b6894bd8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:50:56.954685 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3ddc6052-7394-4e7e-8524-a181b6894bd8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:50:56.955106 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-3ddc6052-7394-4e7e-8524-a181b6894bd8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:50:57.081993 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-3ddc6052-7394-4e7e-8524-a181b6894bd8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:50:57.089311 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-3ddc6052-7394-4e7e-8524-a181b6894bd8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6" status: 200 len: 1368 microversion: 2.1 time: 0.148221 Aug 07 22:50:57.089878 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 529/1036] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:50:56 2022] GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:50:58.111435 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-1766f337-506e-4ee3-9004-534fdc6f5bb6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:50:58.112164 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-1766f337-506e-4ee3-9004-534fdc6f5bb6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:50:58.118888 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1766f337-506e-4ee3-9004-534fdc6f5bb6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:50:58.119309 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1766f337-506e-4ee3-9004-534fdc6f5bb6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:50:58.119754 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1766f337-506e-4ee3-9004-534fdc6f5bb6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:50:58.120474 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1766f337-506e-4ee3-9004-534fdc6f5bb6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:50:58.120935 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1766f337-506e-4ee3-9004-534fdc6f5bb6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:50:58.121364 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1766f337-506e-4ee3-9004-534fdc6f5bb6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:50:58.214669 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-974cf07f-4af0-4e07-a5c9-0813f4cfebd9 req-34460106-b215-44d9-ba86-6a92fb677286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cdd262a-57b5-44bd-a4e0-541425bd19c6", "name": "network-vif-plugged", "status": "completed", "tag": "20f11896-6843-482c-b04f-d3a4220c27c8"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:50:58.221890 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=8 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:50:58.227508 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-974cf07f-4af0-4e07-a5c9-0813f4cfebd9 req-34460106-b215-44d9-ba86-6a92fb677286 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:50:58.228100 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-974cf07f-4af0-4e07-a5c9-0813f4cfebd9 req-34460106-b215-44d9-ba86-6a92fb677286 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:50:58.228602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-974cf07f-4af0-4e07-a5c9-0813f4cfebd9 req-34460106-b215-44d9-ba86-6a92fb677286 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:50:58.241183 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-974cf07f-4af0-4e07-a5c9-0813f4cfebd9 req-34460106-b215-44d9-ba86-6a92fb677286 service nova] Creating event network-vif-plugged:20f11896-6843-482c-b04f-d3a4220c27c8 for instance 0cdd262a-57b5-44bd-a4e0-541425bd19c6 on hv-cinder-85032 Aug 07 22:50:58.246413 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-974cf07f-4af0-4e07-a5c9-0813f4cfebd9 req-34460106-b215-44d9-ba86-6a92fb677286 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035717 Aug 07 22:50:58.251315 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 530/1037] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:50:58.267662 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-1766f337-506e-4ee3-9004-534fdc6f5bb6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:50:58.275415 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-1766f337-506e-4ee3-9004-534fdc6f5bb6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6" status: 200 len: 1368 microversion: 2.1 time: 0.168796 Aug 07 22:50:58.280134 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 508/1038] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:50:58 2022] GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:50:59.300379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-29401d72-b863-475d-bad0-8959ae7e913e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:50:59.301077 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-29401d72-b863-475d-bad0-8959ae7e913e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:50:59.307389 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-29401d72-b863-475d-bad0-8959ae7e913e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:50:59.307871 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-29401d72-b863-475d-bad0-8959ae7e913e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:50:59.308330 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-29401d72-b863-475d-bad0-8959ae7e913e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:50:59.309023 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-29401d72-b863-475d-bad0-8959ae7e913e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:50:59.309472 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-29401d72-b863-475d-bad0-8959ae7e913e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:50:59.309895 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-29401d72-b863-475d-bad0-8959ae7e913e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:50:59.448143 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-29401d72-b863-475d-bad0-8959ae7e913e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:50:59.456095 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-29401d72-b863-475d-bad0-8959ae7e913e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6" status: 200 len: 1368 microversion: 2.1 time: 0.161636 Aug 07 22:50:59.456670 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 531/1039] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:50:59 2022] GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:51:00.477698 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-86e2847a-cc08-4f10-92bd-410ea76b9abc tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:51:00.478296 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-86e2847a-cc08-4f10-92bd-410ea76b9abc tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:51:00.480269 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=10 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:51:00.485634 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-86e2847a-cc08-4f10-92bd-410ea76b9abc tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:00.486198 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-86e2847a-cc08-4f10-92bd-410ea76b9abc tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:00.486629 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-86e2847a-cc08-4f10-92bd-410ea76b9abc tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:00.487316 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-86e2847a-cc08-4f10-92bd-410ea76b9abc tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:00.487804 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-86e2847a-cc08-4f10-92bd-410ea76b9abc tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:00.488963 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-86e2847a-cc08-4f10-92bd-410ea76b9abc tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:00.617953 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-86e2847a-cc08-4f10-92bd-410ea76b9abc tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:51:00.625474 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-86e2847a-cc08-4f10-92bd-410ea76b9abc tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6" status: 200 len: 1558 microversion: 2.1 time: 0.151941 Aug 07 22:51:00.626034 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 509/1040] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:51:00 2022] GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:51:00.646118 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-75230416-b417-41db-9ae6-386f074318d2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:51:00.646635 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-75230416-b417-41db-9ae6-386f074318d2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:51:00.652907 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-75230416-b417-41db-9ae6-386f074318d2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:00.653386 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-75230416-b417-41db-9ae6-386f074318d2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:00.653826 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-75230416-b417-41db-9ae6-386f074318d2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:00.654517 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-75230416-b417-41db-9ae6-386f074318d2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:00.654961 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-75230416-b417-41db-9ae6-386f074318d2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:00.655700 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-75230416-b417-41db-9ae6-386f074318d2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:00.735005 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-75230416-b417-41db-9ae6-386f074318d2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092669 Aug 07 22:51:00.735608 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 532/1041] 10.222.0.30 () {58 vars in 1275 bytes} [Sun Aug 7 22:51:00 2022] GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:51:01.958295 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-3d61a597-1ea2-458c-98a7-0a6bc166bc68 req-934f0871-9e2b-46f0-97ea-1d9dbb877e7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cdd262a-57b5-44bd-a4e0-541425bd19c6", "tag": "20f11896-6843-482c-b04f-d3a4220c27c8"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:51:01.968660 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-3d61a597-1ea2-458c-98a7-0a6bc166bc68 req-934f0871-9e2b-46f0-97ea-1d9dbb877e7a service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:01.969140 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-3d61a597-1ea2-458c-98a7-0a6bc166bc68 req-934f0871-9e2b-46f0-97ea-1d9dbb877e7a service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:01.969564 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-3d61a597-1ea2-458c-98a7-0a6bc166bc68 req-934f0871-9e2b-46f0-97ea-1d9dbb877e7a service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:01.985009 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-3d61a597-1ea2-458c-98a7-0a6bc166bc68 req-934f0871-9e2b-46f0-97ea-1d9dbb877e7a service nova] Creating event network-changed:20f11896-6843-482c-b04f-d3a4220c27c8 for instance 0cdd262a-57b5-44bd-a4e0-541425bd19c6 on hv-cinder-85032 Aug 07 22:51:01.990140 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-3d61a597-1ea2-458c-98a7-0a6bc166bc68 req-934f0871-9e2b-46f0-97ea-1d9dbb877e7a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035457 Aug 07 22:51:01.990751 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 510/1042] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:51:37.762871 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:51:37.763626 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=42 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:51:37.768437 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a64cc534-1650-4cd2-87bf-921481a9f782 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:51:37.768926 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a64cc534-1650-4cd2-87bf-921481a9f782 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:51:37.774833 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a64cc534-1650-4cd2-87bf-921481a9f782 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:37.776165 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a64cc534-1650-4cd2-87bf-921481a9f782 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:37.776165 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a64cc534-1650-4cd2-87bf-921481a9f782 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:37.776572 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a64cc534-1650-4cd2-87bf-921481a9f782 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:37.777021 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a64cc534-1650-4cd2-87bf-921481a9f782 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:37.777441 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a64cc534-1650-4cd2-87bf-921481a9f782 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:37.801302 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a64cc534-1650-4cd2-87bf-921481a9f782 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6/ips" status: 200 len: 149 microversion: 2.1 time: 0.040015 Aug 07 22:51:37.804805 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 533/1043] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Aug 7 22:51:37 2022] GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:51:37.811614 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:51:37.812369 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=34 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:51:37.817164 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-0386eb26-b135-46c1-a20d-1bfbfa927a62 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4726885-5682-46ee-b1a4-cee5e2bc63ab"}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:51:37.819535 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-0386eb26-b135-46c1-a20d-1bfbfa927a62 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:51:37.825425 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0386eb26-b135-46c1-a20d-1bfbfa927a62 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:37.825892 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0386eb26-b135-46c1-a20d-1bfbfa927a62 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:37.826317 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0386eb26-b135-46c1-a20d-1bfbfa927a62 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:37.826994 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0386eb26-b135-46c1-a20d-1bfbfa927a62 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:37.827439 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0386eb26-b135-46c1-a20d-1bfbfa927a62 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:37.827855 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0386eb26-b135-46c1-a20d-1bfbfa927a62 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:37.906537 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.wsgi [None req-0386eb26-b135-46c1-a20d-1bfbfa927a62 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] HTTP exception thrown: Invalid volume: volume c4726885-5682-46ee-b1a4-cee5e2bc63ab is already attached to instances: a5d89236-5cd5-455e-896a-82d335ebf25d Aug 07 22:51:37.908399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-0386eb26-b135-46c1-a20d-1bfbfa927a62 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Request method failure captured: Aug 07 22:51:37.908399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: request: POST /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6/os-volume_attachments HTTP/1.1 Aug 07 22:51:37.908399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept: application/json Aug 07 22:51:37.908399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept-Encoding: identity Aug 07 22:51:37.908399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Connection: close Aug 07 22:51:37.908399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Length: 74 Aug 07 22:51:37.908399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Type: application/json Aug 07 22:51:37.908399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Host: 10.222.0.30 Aug 07 22:51:37.908399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Openstack-System-Scope: None Aug 07 22:51:37.908399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: User-Agent: python-urllib3/1.26.11 Aug 07 22:51:37.908399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Auth-Token: gAAAAABi8EGBVDt0B4T4NuqEVjly370CcefohZV8ujFPZ9aeuiXaRepQ4CoO-34qEEnDnCocUGVNEgiqPEON8F186gqTH91_Is0rvdIVNvdqPDy0X1A6jSCDPucnV0BigazZ7r8jyjsVUtC-BkDw2_ipoRYfpl4-MpZdfC7_1mPtbFtkdVE296w Aug 07 22:51:37.908399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Id: None Aug 07 22:51:37.908399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Name: None Aug 07 22:51:37.908399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Identity-Status: Confirmed Aug 07 22:51:37.908399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Is-Admin-Project: True Aug 07 22:51:37.908399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Id: default Aug 07 22:51:37.908399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Name: Default Aug 07 22:51:37.908399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:51:37.908399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:51:37.908399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Role: reader,member Aug 07 22:51:37.908399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Roles: reader,member Aug 07 22:51:37.910108 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:51:37.910108 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:51:37.910108 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:51:37.910108 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:51:37.910108 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:51:37.910108 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Id: default Aug 07 22:51:37.910108 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Name: Default Aug 07 22:51:37.910108 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Id: 13c06492c8db44759185686bd0a11a57 Aug 07 22:51:37.910108 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Name: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:51:37.910108 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Aug 07 22:51:37.910108 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {"volumeAttachment": {"volumeId": "c4726885-5682-46ee-b1a4-cee5e2bc63ab"}} Aug 07 22:51:37.910108 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: method: > Aug 07 22:51:37.911138 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: exception: Invalid volume: volume c4726885-5682-46ee-b1a4-cee5e2bc63ab is already attached to instances: a5d89236-5cd5-455e-896a-82d335ebf25d Aug 07 22:51:37.911138 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: action_args: {'server_id': '0cdd262a-57b5-44bd-a4e0-541425bd19c6', 'body': {'volumeAttachment': {'volumeId': 'c4726885-5682-46ee-b1a4-cee5e2bc63ab'}}} Aug 07 22:51:37.911138 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:51:37.911138 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:51:37.911138 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 07 22:51:37.911138 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 07 22:51:37.911138 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 22:51:37.911138 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 22:51:37.911138 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 07 22:51:37.911138 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 22:51:37.911138 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 07 22:51:37.911138 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 07 22:51:37.911138 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 07 22:51:37.911138 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 07 22:51:37.911138 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c4726885-5682-46ee-b1a4-cee5e2bc63ab is already attached to instances: a5d89236-5cd5-455e-896a-82d335ebf25d Aug 07 22:51:37.911138 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:51:37.911138 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:51:37.911138 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:51:37.911138 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:51:37.912708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:51:37.912708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:51:37.912708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:51:37.912708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:51:37.912708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:51:37.912708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:51:37.912708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 22:51:37.912708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 22:51:37.912708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 22:51:37.912708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 22:51:37.912708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 22:51:37.912708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 22:51:37.912708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 07 22:51:37.912708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 07 22:51:37.912708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c4726885-5682-46ee-b1a4-cee5e2bc63ab is already attached to instances: a5d89236-5cd5-455e-896a-82d335ebf25d Aug 07 22:51:37.912708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:51:37.912708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:51:37.912708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:51:37.912708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:51:37.912708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:51:37.914651 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:51:37.914651 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:51:37.914651 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:51:37.914651 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c4726885-5682-46ee-b1a4-cee5e2bc63ab is already attached to instances: a5d89236-5cd5-455e-896a-82d335ebf25d Aug 07 22:51:37.914651 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:51:37.914651 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-0386eb26-b135-46c1-a20d-1bfbfa927a62 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Returning 400 to user: Invalid volume: volume c4726885-5682-46ee-b1a4-cee5e2bc63ab is already attached to instances: a5d89236-5cd5-455e-896a-82d335ebf25d {{(pid=129965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:51:37.914651 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-0386eb26-b135-46c1-a20d-1bfbfa927a62 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "POST /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099880 Aug 07 22:51:37.914651 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 511/1044] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 22:51:37 2022] POST /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 22:51:37.919475 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-2f407c2e-bb05-43da-a2a6-bb5f51af340b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:51:37.926836 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-2f407c2e-bb05-43da-a2a6-bb5f51af340b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:51:37.927001 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2f407c2e-bb05-43da-a2a6-bb5f51af340b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:37.927390 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2f407c2e-bb05-43da-a2a6-bb5f51af340b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:37.927825 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2f407c2e-bb05-43da-a2a6-bb5f51af340b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:37.928537 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2f407c2e-bb05-43da-a2a6-bb5f51af340b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:37.928990 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2f407c2e-bb05-43da-a2a6-bb5f51af340b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:37.929415 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2f407c2e-bb05-43da-a2a6-bb5f51af340b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:37.955084 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-2f407c2e-bb05-43da-a2a6-bb5f51af340b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] Going to try to terminate instance {{(pid=129964) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 22:51:38.188308 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-2f407c2e-bb05-43da-a2a6-bb5f51af340b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6" status: 204 len: 0 microversion: 2.1 time: 0.272505 Aug 07 22:51:38.188794 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 534/1045] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:51:37 2022] DELETE /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 22:51:38.197213 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ff3a8bc5-5e59-4b94-97f5-061fcf5c02f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:51:38.197857 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-ff3a8bc5-5e59-4b94-97f5-061fcf5c02f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:51:38.205833 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ff3a8bc5-5e59-4b94-97f5-061fcf5c02f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:38.206310 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ff3a8bc5-5e59-4b94-97f5-061fcf5c02f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:38.206739 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ff3a8bc5-5e59-4b94-97f5-061fcf5c02f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:38.207421 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ff3a8bc5-5e59-4b94-97f5-061fcf5c02f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:38.207941 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ff3a8bc5-5e59-4b94-97f5-061fcf5c02f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:38.208384 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ff3a8bc5-5e59-4b94-97f5-061fcf5c02f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:38.338976 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-ff3a8bc5-5e59-4b94-97f5-061fcf5c02f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:51:38.347211 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-ff3a8bc5-5e59-4b94-97f5-061fcf5c02f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6" status: 200 len: 1682 microversion: 2.1 time: 0.153969 Aug 07 22:51:38.347753 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 512/1046] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:51:38 2022] GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:51:39.367882 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-6d0c6de6-491a-4899-89ff-8ac29be5ba24 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:51:39.377202 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-6d0c6de6-491a-4899-89ff-8ac29be5ba24 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:51:39.377202 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6d0c6de6-491a-4899-89ff-8ac29be5ba24 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:39.377202 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6d0c6de6-491a-4899-89ff-8ac29be5ba24 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:39.377202 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6d0c6de6-491a-4899-89ff-8ac29be5ba24 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:39.377633 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6d0c6de6-491a-4899-89ff-8ac29be5ba24 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:39.377633 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6d0c6de6-491a-4899-89ff-8ac29be5ba24 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:39.377809 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6d0c6de6-491a-4899-89ff-8ac29be5ba24 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:39.512590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-6d0c6de6-491a-4899-89ff-8ac29be5ba24 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:51:39.521974 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-6d0c6de6-491a-4899-89ff-8ac29be5ba24 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6" status: 200 len: 1682 microversion: 2.1 time: 0.158350 Aug 07 22:51:39.522546 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 535/1047] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:51:39 2022] GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:51:40.542811 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-98bacc62-8950-42e1-9ada-b87f24099080 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:51:40.544539 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-98bacc62-8950-42e1-9ada-b87f24099080 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:51:40.550046 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-98bacc62-8950-42e1-9ada-b87f24099080 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:40.550529 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-98bacc62-8950-42e1-9ada-b87f24099080 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:40.550967 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-98bacc62-8950-42e1-9ada-b87f24099080 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:40.551732 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-98bacc62-8950-42e1-9ada-b87f24099080 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:40.552217 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-98bacc62-8950-42e1-9ada-b87f24099080 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:40.552649 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-98bacc62-8950-42e1-9ada-b87f24099080 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:40.629313 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-71be17e6-c4b2-4745-bcc8-dde1b8cd97e4 req-97ea4151-f8c9-4e59-8641-c6d6ef798e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cdd262a-57b5-44bd-a4e0-541425bd19c6", "name": "network-vif-deleted", "tag": "20f11896-6843-482c-b04f-d3a4220c27c8"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:51:40.639779 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-71be17e6-c4b2-4745-bcc8-dde1b8cd97e4 req-97ea4151-f8c9-4e59-8641-c6d6ef798e59 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:40.640278 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-71be17e6-c4b2-4745-bcc8-dde1b8cd97e4 req-97ea4151-f8c9-4e59-8641-c6d6ef798e59 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:40.641528 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-71be17e6-c4b2-4745-bcc8-dde1b8cd97e4 req-97ea4151-f8c9-4e59-8641-c6d6ef798e59 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:40.645628 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-98bacc62-8950-42e1-9ada-b87f24099080 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:51:40.657854 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-71be17e6-c4b2-4745-bcc8-dde1b8cd97e4 req-97ea4151-f8c9-4e59-8641-c6d6ef798e59 service nova] Creating event network-vif-deleted:20f11896-6843-482c-b04f-d3a4220c27c8 for instance 0cdd262a-57b5-44bd-a4e0-541425bd19c6 on hv-cinder-85032 Aug 07 22:51:40.664163 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-71be17e6-c4b2-4745-bcc8-dde1b8cd97e4 req-97ea4151-f8c9-4e59-8641-c6d6ef798e59 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039095 Aug 07 22:51:40.667838 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 536/1048] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:51:40.669363 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-98bacc62-8950-42e1-9ada-b87f24099080 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6" status: 200 len: 1614 microversion: 2.1 time: 0.130360 Aug 07 22:51:40.683731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 513/1049] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:51:40 2022] GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6 => generated 1614 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:51:41.696522 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-4bc36128-c280-4841-8071-4ac8fe1928f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:51:41.697741 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-4bc36128-c280-4841-8071-4ac8fe1928f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:51:41.709525 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4bc36128-c280-4841-8071-4ac8fe1928f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:41.711157 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4bc36128-c280-4841-8071-4ac8fe1928f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:41.711447 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4bc36128-c280-4841-8071-4ac8fe1928f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:41.712686 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4bc36128-c280-4841-8071-4ac8fe1928f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:41.713508 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4bc36128-c280-4841-8071-4ac8fe1928f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:41.714287 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4bc36128-c280-4841-8071-4ac8fe1928f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:41.774901 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4bc36128-c280-4841-8071-4ac8fe1928f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:41.775775 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4bc36128-c280-4841-8071-4ac8fe1928f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:41.776596 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-4bc36128-c280-4841-8071-4ac8fe1928f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:41.777668 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.objects.instance [None req-4bc36128-c280-4841-8071-4ac8fe1928f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lazy-loading 'fault' on Instance uuid 0cdd262a-57b5-44bd-a4e0-541425bd19c6 {{(pid=129964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:51:41.827810 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-4bc36128-c280-4841-8071-4ac8fe1928f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:51:41.835938 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-4bc36128-c280-4841-8071-4ac8fe1928f6 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6" status: 200 len: 1332 microversion: 2.1 time: 0.147596 Aug 07 22:51:41.836545 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 537/1050] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:51:41 2022] GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6 => generated 1332 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:51:42.858195 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ffebe05d-63e9-407b-af39-49c741babb3a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:51:42.858806 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-ffebe05d-63e9-407b-af39-49c741babb3a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:51:42.865792 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ffebe05d-63e9-407b-af39-49c741babb3a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:42.866272 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ffebe05d-63e9-407b-af39-49c741babb3a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:42.866707 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ffebe05d-63e9-407b-af39-49c741babb3a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:42.867394 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ffebe05d-63e9-407b-af39-49c741babb3a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:42.867848 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ffebe05d-63e9-407b-af39-49c741babb3a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:42.868294 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ffebe05d-63e9-407b-af39-49c741babb3a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:42.882224 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.wsgi [None req-ffebe05d-63e9-407b-af39-49c741babb3a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] HTTP exception thrown: Instance 0cdd262a-57b5-44bd-a4e0-541425bd19c6 could not be found. Aug 07 22:51:42.883731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ffebe05d-63e9-407b-af39-49c741babb3a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Request method failure captured: Aug 07 22:51:42.883731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: request: GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6 HTTP/1.1 Aug 07 22:51:42.883731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept: application/json Aug 07 22:51:42.883731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept-Encoding: identity Aug 07 22:51:42.883731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Connection: close Aug 07 22:51:42.883731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Length: 0 Aug 07 22:51:42.883731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Type: application/json Aug 07 22:51:42.883731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Host: 10.222.0.30 Aug 07 22:51:42.883731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Openstack-System-Scope: None Aug 07 22:51:42.883731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: User-Agent: python-urllib3/1.26.11 Aug 07 22:51:42.883731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Auth-Token: gAAAAABi8EGBVDt0B4T4NuqEVjly370CcefohZV8ujFPZ9aeuiXaRepQ4CoO-34qEEnDnCocUGVNEgiqPEON8F186gqTH91_Is0rvdIVNvdqPDy0X1A6jSCDPucnV0BigazZ7r8jyjsVUtC-BkDw2_ipoRYfpl4-MpZdfC7_1mPtbFtkdVE296w Aug 07 22:51:42.883731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Id: None Aug 07 22:51:42.883731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Name: None Aug 07 22:51:42.883731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Identity-Status: Confirmed Aug 07 22:51:42.883731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Is-Admin-Project: True Aug 07 22:51:42.883731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Id: default Aug 07 22:51:42.883731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Name: Default Aug 07 22:51:42.883731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:51:42.883731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:51:42.883731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Role: reader,member Aug 07 22:51:42.883731 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Roles: reader,member Aug 07 22:51:42.885367 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:51:42.885367 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:51:42.885367 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:51:42.885367 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:51:42.885367 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:51:42.885367 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Id: default Aug 07 22:51:42.885367 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Name: Default Aug 07 22:51:42.885367 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Id: 13c06492c8db44759185686bd0a11a57 Aug 07 22:51:42.885367 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Name: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:51:42.885367 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: method: > Aug 07 22:51:42.885367 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: exception: Instance 0cdd262a-57b5-44bd-a4e0-541425bd19c6 could not be found. Aug 07 22:51:42.885367 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: action_args: {'id': '0cdd262a-57b5-44bd-a4e0-541425bd19c6'} Aug 07 22:51:42.886391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:51:42.886391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:51:42.886391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:51:42.886391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:51:42.886391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:51:42.886391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:51:42.886391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:51:42.886391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:51:42.886391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:51:42.886391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:51:42.886391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cdd262a-57b5-44bd-a4e0-541425bd19c6 could not be found. Aug 07 22:51:42.886391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:51:42.886391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:51:42.886391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:51:42.886391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:51:42.886391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:51:42.886391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:51:42.886391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:51:42.886391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:51:42.886391 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:51:42.887631 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:51:42.887631 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:51:42.887631 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:51:42.887631 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:51:42.887631 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:51:42.887631 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:51:42.887631 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:51:42.887631 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cdd262a-57b5-44bd-a4e0-541425bd19c6 could not be found. Aug 07 22:51:42.887631 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:51:42.887631 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:51:42.887631 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:51:42.887631 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:51:42.887631 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:51:42.887631 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:51:42.887631 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:51:42.887631 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:51:42.887631 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cdd262a-57b5-44bd-a4e0-541425bd19c6 could not be found. Aug 07 22:51:42.887631 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:51:42.889188 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ffebe05d-63e9-407b-af39-49c741babb3a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Returning 404 to user: Instance 0cdd262a-57b5-44bd-a4e0-541425bd19c6 could not be found. {{(pid=129965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:51:42.889188 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-ffebe05d-63e9-407b-af39-49c741babb3a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6" status: 404 len: 111 microversion: 2.1 time: 0.030795 Aug 07 22:51:42.889188 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 514/1051] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:51:42 2022] GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:51:42.894312 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-eb46b424-c42a-4146-ba8b-1b79f63f49da tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '.version_select at 0x7fc09fca9a60>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:51:42.974218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-eb46b424-c42a-4146-ba8b-1b79f63f49da tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1283328082" status: 202 len: 0 microversion: 2.1 time: 0.084022 Aug 07 22:51:42.974863 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 538/1052] 10.222.0.30 () {58 vars in 1221 bytes} [Sun Aug 7 22:51:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1283328082 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:51:43.784322 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-3e8a7713-6220-4d3c-855f-2acf78e6fcdb tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:51:43.784816 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-3e8a7713-6220-4d3c-855f-2acf78e6fcdb tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:51:43.790692 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3e8a7713-6220-4d3c-855f-2acf78e6fcdb tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:43.791167 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3e8a7713-6220-4d3c-855f-2acf78e6fcdb tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:43.791600 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3e8a7713-6220-4d3c-855f-2acf78e6fcdb tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:43.792318 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3e8a7713-6220-4d3c-855f-2acf78e6fcdb tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:43.792770 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3e8a7713-6220-4d3c-855f-2acf78e6fcdb tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:43.793225 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3e8a7713-6220-4d3c-855f-2acf78e6fcdb tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:43.872060 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.objects.instance [None req-3e8a7713-6220-4d3c-855f-2acf78e6fcdb tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lazy-loading 'services' on Instance uuid a5d89236-5cd5-455e-896a-82d335ebf25d {{(pid=129965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:51:44.047574 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-3e8a7713-6220-4d3c-855f-2acf78e6fcdb tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d/os-volume_attachments/c4726885-5682-46ee-b1a4-cee5e2bc63ab" status: 202 len: 0 microversion: 2.1 time: 0.266579 Aug 07 22:51:44.048182 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 515/1053] 10.222.0.30 () {58 vars in 1416 bytes} [Sun Aug 7 22:51:43 2022] DELETE /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d/os-volume_attachments/c4726885-5682-46ee-b1a4-cee5e2bc63ab => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:51:44.057724 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-c6420680-d1a2-4903-a4e8-971f0bfe87ac tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:51:44.059857 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-c6420680-d1a2-4903-a4e8-971f0bfe87ac tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:51:44.067350 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c6420680-d1a2-4903-a4e8-971f0bfe87ac tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:44.071877 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c6420680-d1a2-4903-a4e8-971f0bfe87ac tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:44.071877 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c6420680-d1a2-4903-a4e8-971f0bfe87ac tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:44.071877 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c6420680-d1a2-4903-a4e8-971f0bfe87ac tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:44.071877 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c6420680-d1a2-4903-a4e8-971f0bfe87ac tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:44.072336 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c6420680-d1a2-4903-a4e8-971f0bfe87ac tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:44.101533 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-c6420680-d1a2-4903-a4e8-971f0bfe87ac tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049051 Aug 07 22:51:44.105661 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 539/1054] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 22:51:44 2022] GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:51:45.115343 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-b4134829-3405-4f56-b1cb-8931592da50a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:51:45.117679 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-b4134829-3405-4f56-b1cb-8931592da50a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:51:45.123830 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b4134829-3405-4f56-b1cb-8931592da50a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:45.127410 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b4134829-3405-4f56-b1cb-8931592da50a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:45.127410 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b4134829-3405-4f56-b1cb-8931592da50a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:45.127410 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b4134829-3405-4f56-b1cb-8931592da50a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:45.127410 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b4134829-3405-4f56-b1cb-8931592da50a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:45.127841 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-b4134829-3405-4f56-b1cb-8931592da50a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:45.158237 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-b4134829-3405-4f56-b1cb-8931592da50a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047615 Aug 07 22:51:45.158798 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 516/1055] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 22:51:45 2022] GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:51:46.170481 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a325aa7d-1ba7-4ce4-aad9-ff97bb2e426b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:51:46.173390 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a325aa7d-1ba7-4ce4-aad9-ff97bb2e426b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:51:46.179767 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a325aa7d-1ba7-4ce4-aad9-ff97bb2e426b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:46.180284 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a325aa7d-1ba7-4ce4-aad9-ff97bb2e426b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:46.180723 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a325aa7d-1ba7-4ce4-aad9-ff97bb2e426b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:46.181405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a325aa7d-1ba7-4ce4-aad9-ff97bb2e426b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:46.181854 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a325aa7d-1ba7-4ce4-aad9-ff97bb2e426b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:46.182277 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a325aa7d-1ba7-4ce4-aad9-ff97bb2e426b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:46.210575 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a325aa7d-1ba7-4ce4-aad9-ff97bb2e426b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044079 Aug 07 22:51:46.211054 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 540/1056] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 22:51:46 2022] GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 22:51:46.271432 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-66e81af9-24bb-419b-97f2-0f46ba431921 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:51:46.271963 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-66e81af9-24bb-419b-97f2-0f46ba431921 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:51:46.278237 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-66e81af9-24bb-419b-97f2-0f46ba431921 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:46.278708 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-66e81af9-24bb-419b-97f2-0f46ba431921 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:46.279139 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-66e81af9-24bb-419b-97f2-0f46ba431921 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:46.279816 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-66e81af9-24bb-419b-97f2-0f46ba431921 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:46.280296 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-66e81af9-24bb-419b-97f2-0f46ba431921 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:46.280715 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-66e81af9-24bb-419b-97f2-0f46ba431921 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:46.305548 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-66e81af9-24bb-419b-97f2-0f46ba431921 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Going to try to terminate instance {{(pid=129965) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 22:51:46.567615 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-66e81af9-24bb-419b-97f2-0f46ba431921 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d" status: 204 len: 0 microversion: 2.1 time: 0.299658 Aug 07 22:51:46.568223 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 517/1057] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:51:46 2022] DELETE /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 22:51:46.576506 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-6236c728-da86-4b3f-bb60-b8d169d499a3 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:51:46.577131 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-6236c728-da86-4b3f-bb60-b8d169d499a3 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:51:46.583706 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6236c728-da86-4b3f-bb60-b8d169d499a3 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:46.584227 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6236c728-da86-4b3f-bb60-b8d169d499a3 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:46.584669 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6236c728-da86-4b3f-bb60-b8d169d499a3 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:46.585356 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6236c728-da86-4b3f-bb60-b8d169d499a3 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:46.585808 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6236c728-da86-4b3f-bb60-b8d169d499a3 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:46.586227 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-6236c728-da86-4b3f-bb60-b8d169d499a3 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:46.720328 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-6236c728-da86-4b3f-bb60-b8d169d499a3 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:51:46.727941 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-6236c728-da86-4b3f-bb60-b8d169d499a3 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d" status: 200 len: 1680 microversion: 2.1 time: 0.155280 Aug 07 22:51:46.728541 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 541/1058] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:51:46 2022] GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:51:47.751086 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-3c8da1dc-246d-4067-b063-52062533a257 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:51:47.751715 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-3c8da1dc-246d-4067-b063-52062533a257 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:51:47.758077 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3c8da1dc-246d-4067-b063-52062533a257 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:47.758553 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3c8da1dc-246d-4067-b063-52062533a257 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:47.758982 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3c8da1dc-246d-4067-b063-52062533a257 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:47.759667 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3c8da1dc-246d-4067-b063-52062533a257 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:47.760148 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3c8da1dc-246d-4067-b063-52062533a257 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:47.760570 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3c8da1dc-246d-4067-b063-52062533a257 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:47.887546 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-3c8da1dc-246d-4067-b063-52062533a257 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:51:47.895884 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-3c8da1dc-246d-4067-b063-52062533a257 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d" status: 200 len: 1680 microversion: 2.1 time: 0.149870 Aug 07 22:51:47.896482 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 518/1059] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:51:47 2022] GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:51:48.918247 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-eb235767-5631-4dd5-b7d3-cf97722c9b4d tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:51:48.918247 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-eb235767-5631-4dd5-b7d3-cf97722c9b4d tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:51:48.925067 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-eb235767-5631-4dd5-b7d3-cf97722c9b4d tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:48.925558 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-eb235767-5631-4dd5-b7d3-cf97722c9b4d tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:48.925990 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-eb235767-5631-4dd5-b7d3-cf97722c9b4d tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:48.926690 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-eb235767-5631-4dd5-b7d3-cf97722c9b4d tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:48.927147 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-eb235767-5631-4dd5-b7d3-cf97722c9b4d tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:48.927616 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-eb235767-5631-4dd5-b7d3-cf97722c9b4d tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:49.017072 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-eb235767-5631-4dd5-b7d3-cf97722c9b4d tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:51:49.024488 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-eb235767-5631-4dd5-b7d3-cf97722c9b4d tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d" status: 200 len: 1613 microversion: 2.1 time: 0.110811 Aug 07 22:51:49.025066 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 542/1060] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:51:48 2022] GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d => generated 1613 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:51:49.193155 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-3e849b2a-3cd4-47f2-ae1d-6ba4199e641f req-b5795d35-60a1-492f-96ae-12e83a37e82e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5d89236-5cd5-455e-896a-82d335ebf25d", "name": "network-vif-deleted", "tag": "f4601a76-699b-47b3-bb55-443dcd606371"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:51:49.204172 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-3e849b2a-3cd4-47f2-ae1d-6ba4199e641f req-b5795d35-60a1-492f-96ae-12e83a37e82e service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:49.204965 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-3e849b2a-3cd4-47f2-ae1d-6ba4199e641f req-b5795d35-60a1-492f-96ae-12e83a37e82e service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:49.205471 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-3e849b2a-3cd4-47f2-ae1d-6ba4199e641f req-b5795d35-60a1-492f-96ae-12e83a37e82e service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:49.216880 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-3e849b2a-3cd4-47f2-ae1d-6ba4199e641f req-b5795d35-60a1-492f-96ae-12e83a37e82e service nova] Creating event network-vif-deleted:f4601a76-699b-47b3-bb55-443dcd606371 for instance a5d89236-5cd5-455e-896a-82d335ebf25d on hv-cinder-85032 Aug 07 22:51:49.221975 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-3e849b2a-3cd4-47f2-ae1d-6ba4199e641f req-b5795d35-60a1-492f-96ae-12e83a37e82e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032471 Aug 07 22:51:49.222696 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 519/1061] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:51:50.046409 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-39d90c7e-c646-42c4-9b37-04e4650b8d65 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:51:50.047605 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-39d90c7e-c646-42c4-9b37-04e4650b8d65 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:51:50.055194 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-39d90c7e-c646-42c4-9b37-04e4650b8d65 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:50.055594 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-39d90c7e-c646-42c4-9b37-04e4650b8d65 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:50.056006 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-39d90c7e-c646-42c4-9b37-04e4650b8d65 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:50.056843 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-39d90c7e-c646-42c4-9b37-04e4650b8d65 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:50.057295 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-39d90c7e-c646-42c4-9b37-04e4650b8d65 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:50.057713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-39d90c7e-c646-42c4-9b37-04e4650b8d65 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:50.089664 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-39d90c7e-c646-42c4-9b37-04e4650b8d65 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:50.090184 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-39d90c7e-c646-42c4-9b37-04e4650b8d65 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:50.090777 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-39d90c7e-c646-42c4-9b37-04e4650b8d65 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:50.091222 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.objects.instance [None req-39d90c7e-c646-42c4-9b37-04e4650b8d65 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lazy-loading 'fault' on Instance uuid a5d89236-5cd5-455e-896a-82d335ebf25d {{(pid=129964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:51:50.136169 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-39d90c7e-c646-42c4-9b37-04e4650b8d65 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:51:50.144086 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-39d90c7e-c646-42c4-9b37-04e4650b8d65 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d" status: 200 len: 1331 microversion: 2.1 time: 0.101558 Aug 07 22:51:50.144668 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 543/1062] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:51:50 2022] GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:51:51.166933 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ef31e230-30b6-45a2-bb76-50a120005fc5 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:51:51.167657 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-ef31e230-30b6-45a2-bb76-50a120005fc5 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:51:51.174555 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ef31e230-30b6-45a2-bb76-50a120005fc5 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:51.175034 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ef31e230-30b6-45a2-bb76-50a120005fc5 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:51.175473 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ef31e230-30b6-45a2-bb76-50a120005fc5 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:51.176199 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ef31e230-30b6-45a2-bb76-50a120005fc5 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:51.176655 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ef31e230-30b6-45a2-bb76-50a120005fc5 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:51.177082 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ef31e230-30b6-45a2-bb76-50a120005fc5 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:51.190080 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.wsgi [None req-ef31e230-30b6-45a2-bb76-50a120005fc5 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] HTTP exception thrown: Instance a5d89236-5cd5-455e-896a-82d335ebf25d could not be found. Aug 07 22:51:51.191723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ef31e230-30b6-45a2-bb76-50a120005fc5 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Request method failure captured: Aug 07 22:51:51.191723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: request: GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d HTTP/1.1 Aug 07 22:51:51.191723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept: application/json Aug 07 22:51:51.191723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept-Encoding: identity Aug 07 22:51:51.191723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Connection: close Aug 07 22:51:51.191723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Length: 0 Aug 07 22:51:51.191723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Type: application/json Aug 07 22:51:51.191723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Host: 10.222.0.30 Aug 07 22:51:51.191723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Openstack-System-Scope: None Aug 07 22:51:51.191723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: User-Agent: python-urllib3/1.26.11 Aug 07 22:51:51.191723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Auth-Token: gAAAAABi8EGBVDt0B4T4NuqEVjly370CcefohZV8ujFPZ9aeuiXaRepQ4CoO-34qEEnDnCocUGVNEgiqPEON8F186gqTH91_Is0rvdIVNvdqPDy0X1A6jSCDPucnV0BigazZ7r8jyjsVUtC-BkDw2_ipoRYfpl4-MpZdfC7_1mPtbFtkdVE296w Aug 07 22:51:51.191723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Id: None Aug 07 22:51:51.191723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Name: None Aug 07 22:51:51.191723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Identity-Status: Confirmed Aug 07 22:51:51.191723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Is-Admin-Project: True Aug 07 22:51:51.191723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Id: default Aug 07 22:51:51.191723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Name: Default Aug 07 22:51:51.191723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:51:51.191723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:51:51.191723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Role: reader,member Aug 07 22:51:51.191723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Roles: reader,member Aug 07 22:51:51.193425 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:51:51.193425 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:51:51.193425 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:51:51.193425 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:51:51.193425 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:51:51.193425 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Id: default Aug 07 22:51:51.193425 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Name: Default Aug 07 22:51:51.193425 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Id: 13c06492c8db44759185686bd0a11a57 Aug 07 22:51:51.193425 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Name: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:51:51.193425 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: method: > Aug 07 22:51:51.193425 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: exception: Instance a5d89236-5cd5-455e-896a-82d335ebf25d could not be found. Aug 07 22:51:51.193425 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: action_args: {'id': 'a5d89236-5cd5-455e-896a-82d335ebf25d'} Aug 07 22:51:51.194512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:51:51.194512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:51:51.194512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:51:51.194512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:51:51.194512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:51:51.194512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:51:51.194512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:51:51.194512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:51:51.194512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:51:51.194512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:51:51.194512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5d89236-5cd5-455e-896a-82d335ebf25d could not be found. Aug 07 22:51:51.194512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:51:51.194512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:51:51.194512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:51:51.194512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:51:51.194512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:51:51.194512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:51:51.194512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:51:51.194512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:51:51.194512 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:51:51.196090 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:51:51.196090 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:51:51.196090 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:51:51.196090 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:51:51.196090 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:51:51.196090 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:51:51.196090 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:51:51.196090 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5d89236-5cd5-455e-896a-82d335ebf25d could not be found. Aug 07 22:51:51.196090 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:51:51.196090 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:51:51.196090 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:51:51.196090 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:51:51.196090 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:51:51.196090 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:51:51.196090 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:51:51.196090 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:51:51.196090 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5d89236-5cd5-455e-896a-82d335ebf25d could not be found. Aug 07 22:51:51.196090 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:51:51.197733 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ef31e230-30b6-45a2-bb76-50a120005fc5 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Returning 404 to user: Instance a5d89236-5cd5-455e-896a-82d335ebf25d could not be found. {{(pid=129965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:51:51.197733 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-ef31e230-30b6-45a2-bb76-50a120005fc5 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d" status: 404 len: 111 microversion: 2.1 time: 0.030903 Aug 07 22:51:51.197733 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 520/1063] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:51:51 2022] GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:51:51.201782 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-5213c65e-f90d-44a0-b85b-c38cc1c0df80 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '.version_select at 0x7fc09fdffc10>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:51:51.311233 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-5213c65e-f90d-44a0-b85b-c38cc1c0df80 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2039379767" status: 202 len: 0 microversion: 2.1 time: 0.113181 Aug 07 22:51:51.311818 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 544/1064] 10.222.0.30 () {58 vars in 1221 bytes} [Sun Aug 7 22:51:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2039379767 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:51:52.046820 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-3ef435eb-1d91-42e2-9306-6810f96fe773 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Action: 'create', calling method: .version_select at 0x7fc0ac6b2c10>, body: {"keypair": {"name": "tempest-keypair-1893146974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoUC+aFeeHzBapC++dqkqd2gDKM0TYsFWSm4O8apowI2T4t7K/gFLA378HQqzG/bRMVlkHo5q0ILhaX5N6PQrcqmfceCo0oL4tH5/woMRrwe5oclWHdIYcN88VZM64c/Q=="}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:51:52.061717 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-3ef435eb-1d91-42e2-9306-6810f96fe773 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Getting quotas for project 4571d38eeff749fcb073842d5ad4fc65. Resources: {'key_pairs'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:51:52.066161 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-3ef435eb-1d91-42e2-9306-6810f96fe773 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Getting quotas for user 13c06492c8db44759185686bd0a11a57 and project 4571d38eeff749fcb073842d5ad4fc65. Resources: {'key_pairs'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:51:52.144776 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-3ef435eb-1d91-42e2-9306-6810f96fe773 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.101918 Aug 07 22:51:52.145878 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 521/1065] 10.222.0.30 () {60 vars in 1159 bytes} [Sun Aug 7 22:51:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:51:54.211943 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-bd8657df-7996-49bf-90e2-e35e53b95893 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-391884428", "imageRef": "91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d15b754-28f9-4d07-a0c7-ae4f93625ddd"}], "security_groups": [{"name": "tempest-securitygroup--107599993"}], "key_name": "tempest-keypair-1893146974", "user_data": "}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:51:54.315823 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.network.neutron [None req-bd8657df-7996-49bf-90e2-e35e53b95893 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] validate_networks() for [('2d15b754-28f9-4d07-a0c7-ae4f93625ddd', None, None, None, None, None)] {{(pid=129964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 22:51:54.946474 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-bd8657df-7996-49bf-90e2-e35e53b95893 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Flavor limits 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 22:51:54.946899 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-bd8657df-7996-49bf-90e2-e35e53b95893 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Image limits 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 22:51:54.947367 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-bd8657df-7996-49bf-90e2-e35e53b95893 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Flavor pref 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 22:51:54.947776 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-bd8657df-7996-49bf-90e2-e35e53b95893 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Image pref 0:0:0 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 22:51:54.948280 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.virt.hardware [None req-bd8657df-7996-49bf-90e2-e35e53b95893 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 22:51:54.957769 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bd8657df-7996-49bf-90e2-e35e53b95893 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:54.958252 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bd8657df-7996-49bf-90e2-e35e53b95893 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:54.958680 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bd8657df-7996-49bf-90e2-e35e53b95893 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:54.959400 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bd8657df-7996-49bf-90e2-e35e53b95893 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:54.959851 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bd8657df-7996-49bf-90e2-e35e53b95893 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:54.960301 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bd8657df-7996-49bf-90e2-e35e53b95893 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:54.977492 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-bd8657df-7996-49bf-90e2-e35e53b95893 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Getting quotas for project 4571d38eeff749fcb073842d5ad4fc65. Resources: {'cores', 'instances', 'ram'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:51:54.981429 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-bd8657df-7996-49bf-90e2-e35e53b95893 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Getting quotas for user 13c06492c8db44759185686bd0a11a57 and project 4571d38eeff749fcb073842d5ad4fc65. Resources: {'cores', 'instances', 'ram'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:51:54.992414 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-bd8657df-7996-49bf-90e2-e35e53b95893 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Going to run 1 instances... {{(pid=129964) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 22:51:54.994662 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-bd8657df-7996-49bf-90e2-e35e53b95893 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 22:51:55.121478 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-bd8657df-7996-49bf-90e2-e35e53b95893 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.914501 Aug 07 22:51:55.122124 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 545/1066] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 22:51:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 22:51:55.134381 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-2c84a1de-dd59-4925-b2c8-1e182cb1b16a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:51:55.135088 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-2c84a1de-dd59-4925-b2c8-1e182cb1b16a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:51:55.193545 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-2c84a1de-dd59-4925-b2c8-1e182cb1b16a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:51:55.200247 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-2c84a1de-dd59-4925-b2c8-1e182cb1b16a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf" status: 200 len: 1241 microversion: 2.1 time: 0.070377 Aug 07 22:51:55.200807 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 522/1067] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:51:55 2022] GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:51:56.222848 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-262c11b5-b4cf-415b-a744-16b83fad1d3d tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:51:56.223457 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-262c11b5-b4cf-415b-a744-16b83fad1d3d tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:51:56.229634 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-262c11b5-b4cf-415b-a744-16b83fad1d3d tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:56.230110 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-262c11b5-b4cf-415b-a744-16b83fad1d3d tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:56.230550 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-262c11b5-b4cf-415b-a744-16b83fad1d3d tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:56.231264 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-262c11b5-b4cf-415b-a744-16b83fad1d3d tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:56.231713 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-262c11b5-b4cf-415b-a744-16b83fad1d3d tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:56.232174 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-262c11b5-b4cf-415b-a744-16b83fad1d3d tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:56.295244 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-262c11b5-b4cf-415b-a744-16b83fad1d3d tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:51:56.303581 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-262c11b5-b4cf-415b-a744-16b83fad1d3d tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf" status: 200 len: 1245 microversion: 2.1 time: 0.085294 Aug 07 22:51:56.304200 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 546/1068] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:51:56 2022] GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:51:57.324715 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d6100ffd-9645-4cf5-841d-3b33fe3dcf67 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:51:57.325308 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-d6100ffd-9645-4cf5-841d-3b33fe3dcf67 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:51:57.332206 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d6100ffd-9645-4cf5-841d-3b33fe3dcf67 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:57.332716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d6100ffd-9645-4cf5-841d-3b33fe3dcf67 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:57.333370 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d6100ffd-9645-4cf5-841d-3b33fe3dcf67 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:57.334071 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d6100ffd-9645-4cf5-841d-3b33fe3dcf67 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:57.334526 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d6100ffd-9645-4cf5-841d-3b33fe3dcf67 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:57.334958 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d6100ffd-9645-4cf5-841d-3b33fe3dcf67 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:57.403801 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-d6100ffd-9645-4cf5-841d-3b33fe3dcf67 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:51:57.412111 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-d6100ffd-9645-4cf5-841d-3b33fe3dcf67 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf" status: 200 len: 1311 microversion: 2.1 time: 0.091241 Aug 07 22:51:57.417629 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 523/1069] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:51:57 2022] GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf => generated 1311 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:51:58.433247 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-399d0bb3-0693-4a77-b2a4-14a293070242 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:51:58.433853 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-399d0bb3-0693-4a77-b2a4-14a293070242 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:51:58.440050 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-399d0bb3-0693-4a77-b2a4-14a293070242 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:58.440569 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-399d0bb3-0693-4a77-b2a4-14a293070242 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:58.441142 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-399d0bb3-0693-4a77-b2a4-14a293070242 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:58.441834 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-399d0bb3-0693-4a77-b2a4-14a293070242 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:58.442283 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-399d0bb3-0693-4a77-b2a4-14a293070242 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:58.442762 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-399d0bb3-0693-4a77-b2a4-14a293070242 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:58.631409 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-399d0bb3-0693-4a77-b2a4-14a293070242 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:51:58.638785 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-399d0bb3-0693-4a77-b2a4-14a293070242 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf" status: 200 len: 1366 microversion: 2.1 time: 0.209441 Aug 07 22:51:58.639347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 547/1070] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:51:58 2022] GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:51:58.754812 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-e77511b7-afb9-4efa-9160-c7df8746d71a req-142bee1e-a47b-4b1e-9ae0-43b7b1d94b43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16ab4ae6-8135-4ba5-8fff-4a25f284a1cf", "tag": "478d29d3-847a-4d78-a000-ad4e54351799"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:51:58.765208 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-e77511b7-afb9-4efa-9160-c7df8746d71a req-142bee1e-a47b-4b1e-9ae0-43b7b1d94b43 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:58.765686 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-e77511b7-afb9-4efa-9160-c7df8746d71a req-142bee1e-a47b-4b1e-9ae0-43b7b1d94b43 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:58.766500 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-e77511b7-afb9-4efa-9160-c7df8746d71a req-142bee1e-a47b-4b1e-9ae0-43b7b1d94b43 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:58.777720 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-e77511b7-afb9-4efa-9160-c7df8746d71a req-142bee1e-a47b-4b1e-9ae0-43b7b1d94b43 service nova] Creating event network-changed:478d29d3-847a-4d78-a000-ad4e54351799 for instance 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf on hv-cinder-85032 Aug 07 22:51:58.783790 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-e77511b7-afb9-4efa-9160-c7df8746d71a req-142bee1e-a47b-4b1e-9ae0-43b7b1d94b43 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033057 Aug 07 22:51:58.784432 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 524/1071] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:51:59.660040 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-914ccffc-49db-48af-b5c6-5419b506e707 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:51:59.660582 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-914ccffc-49db-48af-b5c6-5419b506e707 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:51:59.666922 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-914ccffc-49db-48af-b5c6-5419b506e707 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:59.667467 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-914ccffc-49db-48af-b5c6-5419b506e707 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:59.667898 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-914ccffc-49db-48af-b5c6-5419b506e707 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:59.668605 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-914ccffc-49db-48af-b5c6-5419b506e707 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:51:59.669051 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-914ccffc-49db-48af-b5c6-5419b506e707 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:51:59.669467 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-914ccffc-49db-48af-b5c6-5419b506e707 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:51:59.808852 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-914ccffc-49db-48af-b5c6-5419b506e707 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:51:59.816894 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-914ccffc-49db-48af-b5c6-5419b506e707 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf" status: 200 len: 1366 microversion: 2.1 time: 0.160815 Aug 07 22:51:59.817455 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 548/1072] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:51:59 2022] GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:52:00.839075 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d62bdb49-adab-45d6-b585-705047ab1072 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:52:00.839703 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-d62bdb49-adab-45d6-b585-705047ab1072 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:52:00.846504 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d62bdb49-adab-45d6-b585-705047ab1072 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:00.847125 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d62bdb49-adab-45d6-b585-705047ab1072 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:00.847566 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d62bdb49-adab-45d6-b585-705047ab1072 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:00.848308 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d62bdb49-adab-45d6-b585-705047ab1072 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:00.848765 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d62bdb49-adab-45d6-b585-705047ab1072 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:00.849196 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d62bdb49-adab-45d6-b585-705047ab1072 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:00.988433 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-d62bdb49-adab-45d6-b585-705047ab1072 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:52:00.996053 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-d62bdb49-adab-45d6-b585-705047ab1072 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf" status: 200 len: 1366 microversion: 2.1 time: 0.161997 Aug 07 22:52:00.996617 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 525/1073] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:52:00 2022] GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:52:02.018650 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-bed1a9b8-b664-449e-a1af-bbc03cd5cef4 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:52:02.019267 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-bed1a9b8-b664-449e-a1af-bbc03cd5cef4 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:52:02.025737 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bed1a9b8-b664-449e-a1af-bbc03cd5cef4 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:02.027639 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bed1a9b8-b664-449e-a1af-bbc03cd5cef4 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:02.027639 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bed1a9b8-b664-449e-a1af-bbc03cd5cef4 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:02.027639 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bed1a9b8-b664-449e-a1af-bbc03cd5cef4 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:02.028045 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bed1a9b8-b664-449e-a1af-bbc03cd5cef4 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:02.028246 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bed1a9b8-b664-449e-a1af-bbc03cd5cef4 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:02.159933 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-bed1a9b8-b664-449e-a1af-bbc03cd5cef4 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:52:02.167354 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-bed1a9b8-b664-449e-a1af-bbc03cd5cef4 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf" status: 200 len: 1366 microversion: 2.1 time: 0.152940 Aug 07 22:52:02.167928 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 549/1074] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:52:02 2022] GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:52:03.189046 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-123ebb6a-868e-4e79-a946-2750f57a66e1 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:52:03.189655 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-123ebb6a-868e-4e79-a946-2750f57a66e1 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:52:03.196231 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-123ebb6a-868e-4e79-a946-2750f57a66e1 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:03.196652 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-123ebb6a-868e-4e79-a946-2750f57a66e1 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:03.197082 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-123ebb6a-868e-4e79-a946-2750f57a66e1 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:03.197764 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-123ebb6a-868e-4e79-a946-2750f57a66e1 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:03.198215 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-123ebb6a-868e-4e79-a946-2750f57a66e1 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:03.198636 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-123ebb6a-868e-4e79-a946-2750f57a66e1 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:03.325394 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-123ebb6a-868e-4e79-a946-2750f57a66e1 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:52:03.333635 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-123ebb6a-868e-4e79-a946-2750f57a66e1 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf" status: 200 len: 1366 microversion: 2.1 time: 0.148989 Aug 07 22:52:03.334230 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 526/1075] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:52:03 2022] GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:52:04.337884 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-f0df5b8e-12f4-42ce-917c-dd46fceb626d req-19174661-8fb8-4333-9b3e-efa29061a5a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ab4ae6-8135-4ba5-8fff-4a25f284a1cf", "name": "network-vif-plugged", "status": "completed", "tag": "478d29d3-847a-4d78-a000-ad4e54351799"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:52:04.348553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-f0df5b8e-12f4-42ce-917c-dd46fceb626d req-19174661-8fb8-4333-9b3e-efa29061a5a0 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:04.349030 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-f0df5b8e-12f4-42ce-917c-dd46fceb626d req-19174661-8fb8-4333-9b3e-efa29061a5a0 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:04.349460 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-f0df5b8e-12f4-42ce-917c-dd46fceb626d req-19174661-8fb8-4333-9b3e-efa29061a5a0 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:04.354578 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ad45944b-7e30-4901-9493-3e1a6b06e2f8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:52:04.355217 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-ad45944b-7e30-4901-9493-3e1a6b06e2f8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:52:04.362160 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-f0df5b8e-12f4-42ce-917c-dd46fceb626d req-19174661-8fb8-4333-9b3e-efa29061a5a0 service nova] Creating event network-vif-plugged:478d29d3-847a-4d78-a000-ad4e54351799 for instance 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf on hv-cinder-85032 Aug 07 22:52:04.362322 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad45944b-7e30-4901-9493-3e1a6b06e2f8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:04.362476 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad45944b-7e30-4901-9493-3e1a6b06e2f8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:04.362896 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad45944b-7e30-4901-9493-3e1a6b06e2f8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:04.363600 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad45944b-7e30-4901-9493-3e1a6b06e2f8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:04.364072 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad45944b-7e30-4901-9493-3e1a6b06e2f8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:04.364503 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad45944b-7e30-4901-9493-3e1a6b06e2f8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:04.365972 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-f0df5b8e-12f4-42ce-917c-dd46fceb626d req-19174661-8fb8-4333-9b3e-efa29061a5a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031754 Aug 07 22:52:04.366767 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 550/1076] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:52:04.500418 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-ad45944b-7e30-4901-9493-3e1a6b06e2f8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:52:04.507769 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-ad45944b-7e30-4901-9493-3e1a6b06e2f8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf" status: 200 len: 1366 microversion: 2.1 time: 0.157042 Aug 07 22:52:04.508351 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 527/1077] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:52:04 2022] GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:52:05.530285 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-d048632e-ae5d-4a5d-a375-759e0ecca096 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:52:05.530987 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-d048632e-ae5d-4a5d-a375-759e0ecca096 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:52:05.533760 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=2 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:52:05.534467 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=6 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:52:05.539818 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d048632e-ae5d-4a5d-a375-759e0ecca096 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:05.540336 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d048632e-ae5d-4a5d-a375-759e0ecca096 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:05.540775 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d048632e-ae5d-4a5d-a375-759e0ecca096 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:05.541465 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d048632e-ae5d-4a5d-a375-759e0ecca096 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:05.541920 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d048632e-ae5d-4a5d-a375-759e0ecca096 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:05.542347 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d048632e-ae5d-4a5d-a375-759e0ecca096 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:05.560964 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:52:05.671551 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-d048632e-ae5d-4a5d-a375-759e0ecca096 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:52:05.679934 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-d048632e-ae5d-4a5d-a375-759e0ecca096 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf" status: 200 len: 1366 microversion: 2.1 time: 0.153870 Aug 07 22:52:05.680524 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 551/1078] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:52:05 2022] GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:52:06.700466 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7999d4cd-a950-4dd9-a593-7d648deed324 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:52:06.701005 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-7999d4cd-a950-4dd9-a593-7d648deed324 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:52:06.702976 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=6 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:52:06.708224 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7999d4cd-a950-4dd9-a593-7d648deed324 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:06.708704 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7999d4cd-a950-4dd9-a593-7d648deed324 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:06.709142 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7999d4cd-a950-4dd9-a593-7d648deed324 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:06.709826 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7999d4cd-a950-4dd9-a593-7d648deed324 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:06.710278 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7999d4cd-a950-4dd9-a593-7d648deed324 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:06.710700 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7999d4cd-a950-4dd9-a593-7d648deed324 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:06.840855 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-7999d4cd-a950-4dd9-a593-7d648deed324 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:52:06.848786 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-7999d4cd-a950-4dd9-a593-7d648deed324 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf" status: 200 len: 1555 microversion: 2.1 time: 0.152370 Aug 07 22:52:06.849341 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 528/1079] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:52:06 2022] GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:52:06.870092 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-d520bdec-d1f9-4b04-b638-210e71640803 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:52:06.870603 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-d520bdec-d1f9-4b04-b638-210e71640803 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:52:06.877392 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d520bdec-d1f9-4b04-b638-210e71640803 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:06.877864 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d520bdec-d1f9-4b04-b638-210e71640803 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:06.878292 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d520bdec-d1f9-4b04-b638-210e71640803 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:06.878970 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d520bdec-d1f9-4b04-b638-210e71640803 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:06.879417 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d520bdec-d1f9-4b04-b638-210e71640803 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:06.879833 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-d520bdec-d1f9-4b04-b638-210e71640803 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:06.956133 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-d520bdec-d1f9-4b04-b638-210e71640803 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090085 Aug 07 22:52:06.956724 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 552/1080] 10.222.0.30 () {58 vars in 1275 bytes} [Sun Aug 7 22:52:06 2022] GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:52:07.931884 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-49a66280-ecf9-4f5f-9504-5244785a81fb req-0f6baba5-fed4-4a07-b774-8515d9001b12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16ab4ae6-8135-4ba5-8fff-4a25f284a1cf", "tag": "478d29d3-847a-4d78-a000-ad4e54351799"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:52:07.942548 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-49a66280-ecf9-4f5f-9504-5244785a81fb req-0f6baba5-fed4-4a07-b774-8515d9001b12 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:07.943029 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-49a66280-ecf9-4f5f-9504-5244785a81fb req-0f6baba5-fed4-4a07-b774-8515d9001b12 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:07.943457 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-49a66280-ecf9-4f5f-9504-5244785a81fb req-0f6baba5-fed4-4a07-b774-8515d9001b12 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:07.955520 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-49a66280-ecf9-4f5f-9504-5244785a81fb req-0f6baba5-fed4-4a07-b774-8515d9001b12 service nova] Creating event network-changed:478d29d3-847a-4d78-a000-ad4e54351799 for instance 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf on hv-cinder-85032 Aug 07 22:52:07.960569 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-49a66280-ecf9-4f5f-9504-5244785a81fb req-0f6baba5-fed4-4a07-b774-8515d9001b12 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032297 Aug 07 22:52:07.961167 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 529/1081] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:52:43.882370 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:52:43.883119 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=6 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:52:43.887023 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-2a22faec-c3b9-4b67-a018-69f79915871b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:52:43.887514 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-2a22faec-c3b9-4b67-a018-69f79915871b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:52:43.894166 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2a22faec-c3b9-4b67-a018-69f79915871b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:43.894656 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2a22faec-c3b9-4b67-a018-69f79915871b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:43.895081 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2a22faec-c3b9-4b67-a018-69f79915871b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:43.895761 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2a22faec-c3b9-4b67-a018-69f79915871b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:43.896248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2a22faec-c3b9-4b67-a018-69f79915871b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:43.896672 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2a22faec-c3b9-4b67-a018-69f79915871b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:43.919172 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-2a22faec-c3b9-4b67-a018-69f79915871b tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf/ips" status: 200 len: 149 microversion: 2.1 time: 0.038327 Aug 07 22:52:43.919732 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 553/1082] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Aug 7 22:52:43 2022] GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:52:45.462696 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:52:45.463463 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:52:45.467727 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d2faef22-d794-436d-87f2-89d636512717 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b78c5761-ac4f-4921-92f8-37ec6e4d7712"}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:52:45.473383 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-d2faef22-d794-436d-87f2-89d636512717 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:52:45.477143 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d2faef22-d794-436d-87f2-89d636512717 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:45.478655 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d2faef22-d794-436d-87f2-89d636512717 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:45.479097 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d2faef22-d794-436d-87f2-89d636512717 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:45.479811 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d2faef22-d794-436d-87f2-89d636512717 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:45.480341 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d2faef22-d794-436d-87f2-89d636512717 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:45.480771 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d2faef22-d794-436d-87f2-89d636512717 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:46.410510 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-d2faef22-d794-436d-87f2-89d636512717 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "POST /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.949429 Aug 07 22:52:46.411117 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 530/1083] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 22:52:45 2022] POST /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf/os-volume_attachments => generated 194 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:52:53.924617 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a07fb69a-256e-47d5-918b-6c58046b5126 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b78c5761-ac4f-4921-92f8-37ec6e4d7712"}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:52:53.926970 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-a07fb69a-256e-47d5-918b-6c58046b5126 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:52:53.934042 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a07fb69a-256e-47d5-918b-6c58046b5126 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:53.934519 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a07fb69a-256e-47d5-918b-6c58046b5126 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:53.934957 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a07fb69a-256e-47d5-918b-6c58046b5126 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:53.935634 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a07fb69a-256e-47d5-918b-6c58046b5126 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:53.936106 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a07fb69a-256e-47d5-918b-6c58046b5126 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:53.936527 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-a07fb69a-256e-47d5-918b-6c58046b5126 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:54.066460 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-a07fb69a-256e-47d5-918b-6c58046b5126 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] HTTP exception thrown: Invalid volume: volume b78c5761-ac4f-4921-92f8-37ec6e4d7712 is already attached to instances: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf Aug 07 22:52:54.068208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a07fb69a-256e-47d5-918b-6c58046b5126 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Request method failure captured: Aug 07 22:52:54.068208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: POST /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf/os-volume_attachments HTTP/1.1 Aug 07 22:52:54.068208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:52:54.068208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:52:54.068208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:52:54.068208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 74 Aug 07 22:52:54.068208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:52:54.068208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:52:54.068208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:52:54.068208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:52:54.068208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8EGBVDt0B4T4NuqEVjly370CcefohZV8ujFPZ9aeuiXaRepQ4CoO-34qEEnDnCocUGVNEgiqPEON8F186gqTH91_Is0rvdIVNvdqPDy0X1A6jSCDPucnV0BigazZ7r8jyjsVUtC-BkDw2_ipoRYfpl4-MpZdfC7_1mPtbFtkdVE296w Aug 07 22:52:54.068208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:52:54.068208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:52:54.068208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:52:54.068208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:52:54.068208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:52:54.068208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:52:54.068208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:52:54.068208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:52:54.068208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:52:54.068208 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:52:54.070779 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:52:54.070779 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:52:54.070779 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:52:54.070779 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:52:54.070779 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:52:54.070779 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:52:54.070779 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:52:54.070779 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: 13c06492c8db44759185686bd0a11a57 Aug 07 22:52:54.070779 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:52:54.070779 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Aug 07 22:52:54.070779 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {"volumeAttachment": {"volumeId": "b78c5761-ac4f-4921-92f8-37ec6e4d7712"}} Aug 07 22:52:54.070779 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: > Aug 07 22:52:54.071789 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Invalid volume: volume b78c5761-ac4f-4921-92f8-37ec6e4d7712 is already attached to instances: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf Aug 07 22:52:54.071789 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'server_id': '16ab4ae6-8135-4ba5-8fff-4a25f284a1cf', 'body': {'volumeAttachment': {'volumeId': 'b78c5761-ac4f-4921-92f8-37ec6e4d7712'}}} Aug 07 22:52:54.071789 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:52:54.071789 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:52:54.071789 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 07 22:52:54.071789 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 07 22:52:54.071789 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 22:52:54.071789 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 22:52:54.071789 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 07 22:52:54.071789 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 22:52:54.071789 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 07 22:52:54.071789 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 07 22:52:54.071789 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 07 22:52:54.071789 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 07 22:52:54.071789 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b78c5761-ac4f-4921-92f8-37ec6e4d7712 is already attached to instances: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf Aug 07 22:52:54.071789 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:52:54.071789 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:52:54.071789 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:52:54.071789 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:52:54.073428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:52:54.073428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:52:54.073428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:52:54.073428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:52:54.073428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:52:54.073428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:52:54.073428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 22:52:54.073428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 22:52:54.073428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 22:52:54.073428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 22:52:54.073428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 22:52:54.073428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 22:52:54.073428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 07 22:52:54.073428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 07 22:52:54.073428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b78c5761-ac4f-4921-92f8-37ec6e4d7712 is already attached to instances: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf Aug 07 22:52:54.073428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:52:54.073428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:52:54.073428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:52:54.073428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:52:54.073428 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:52:54.074994 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:52:54.074994 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:52:54.074994 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:52:54.074994 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b78c5761-ac4f-4921-92f8-37ec6e4d7712 is already attached to instances: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf Aug 07 22:52:54.074994 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:52:54.074994 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-a07fb69a-256e-47d5-918b-6c58046b5126 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Returning 400 to user: Invalid volume: volume b78c5761-ac4f-4921-92f8-37ec6e4d7712 is already attached to instances: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:52:54.074994 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-a07fb69a-256e-47d5-918b-6c58046b5126 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "POST /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.150627 Aug 07 22:52:54.074994 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 554/1084] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 22:52:53 2022] POST /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf/os-volume_attachments => generated 174 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 22:52:54.134441 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-0f6f1780-0e89-44ab-b627-5872dd5759c2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:52:54.135027 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-0f6f1780-0e89-44ab-b627-5872dd5759c2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:52:54.141304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0f6f1780-0e89-44ab-b627-5872dd5759c2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:54.142035 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0f6f1780-0e89-44ab-b627-5872dd5759c2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:54.142474 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0f6f1780-0e89-44ab-b627-5872dd5759c2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:54.143163 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0f6f1780-0e89-44ab-b627-5872dd5759c2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:54.143616 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0f6f1780-0e89-44ab-b627-5872dd5759c2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:54.144056 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-0f6f1780-0e89-44ab-b627-5872dd5759c2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:54.222356 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.objects.instance [None req-0f6f1780-0e89-44ab-b627-5872dd5759c2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lazy-loading 'services' on Instance uuid 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf {{(pid=129965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:52:54.486158 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-0f6f1780-0e89-44ab-b627-5872dd5759c2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "DELETE /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf/os-volume_attachments/b78c5761-ac4f-4921-92f8-37ec6e4d7712" status: 202 len: 0 microversion: 2.1 time: 0.356243 Aug 07 22:52:54.486743 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 531/1085] 10.222.0.30 () {58 vars in 1416 bytes} [Sun Aug 7 22:52:54 2022] DELETE /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf/os-volume_attachments/b78c5761-ac4f-4921-92f8-37ec6e4d7712 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:52:54.495065 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-abb7188f-584b-47b8-9c80-dd39580ea9ff tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:52:54.497252 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-abb7188f-584b-47b8-9c80-dd39580ea9ff tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:52:54.504441 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-abb7188f-584b-47b8-9c80-dd39580ea9ff tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:54.505059 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-abb7188f-584b-47b8-9c80-dd39580ea9ff tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:54.505184 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-abb7188f-584b-47b8-9c80-dd39580ea9ff tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:54.505902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-abb7188f-584b-47b8-9c80-dd39580ea9ff tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:54.506350 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-abb7188f-584b-47b8-9c80-dd39580ea9ff tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:54.506768 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-abb7188f-584b-47b8-9c80-dd39580ea9ff tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:54.536938 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-abb7188f-584b-47b8-9c80-dd39580ea9ff tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045847 Aug 07 22:52:54.537491 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 555/1086] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 22:52:54 2022] GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 22:52:55.551123 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-542635e5-9a72-4007-902b-b3486f1fc677 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:52:55.553553 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-542635e5-9a72-4007-902b-b3486f1fc677 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:52:55.559771 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-542635e5-9a72-4007-902b-b3486f1fc677 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:55.560285 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-542635e5-9a72-4007-902b-b3486f1fc677 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:55.560719 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-542635e5-9a72-4007-902b-b3486f1fc677 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:55.561466 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-542635e5-9a72-4007-902b-b3486f1fc677 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:55.561922 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-542635e5-9a72-4007-902b-b3486f1fc677 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:55.562339 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-542635e5-9a72-4007-902b-b3486f1fc677 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:55.590786 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-542635e5-9a72-4007-902b-b3486f1fc677 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045073 Aug 07 22:52:55.591342 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 532/1087] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 22:52:55 2022] GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 22:52:55.652665 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-2d0f3817-ca38-422c-a44a-17f92eae5696 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:52:55.653174 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-2d0f3817-ca38-422c-a44a-17f92eae5696 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:52:55.660119 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2d0f3817-ca38-422c-a44a-17f92eae5696 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:55.660642 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2d0f3817-ca38-422c-a44a-17f92eae5696 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:55.661054 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2d0f3817-ca38-422c-a44a-17f92eae5696 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:55.661750 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2d0f3817-ca38-422c-a44a-17f92eae5696 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:55.662201 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2d0f3817-ca38-422c-a44a-17f92eae5696 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:55.662623 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2d0f3817-ca38-422c-a44a-17f92eae5696 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:55.689502 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-2d0f3817-ca38-422c-a44a-17f92eae5696 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Going to try to terminate instance {{(pid=129964) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 22:52:55.955371 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-2d0f3817-ca38-422c-a44a-17f92eae5696 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "DELETE /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf" status: 204 len: 0 microversion: 2.1 time: 0.306211 Aug 07 22:52:55.955991 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 556/1088] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:52:55 2022] DELETE /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 22:52:55.964930 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-459d4c70-2b26-41bb-900e-21615a2b9163 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:52:55.965544 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-459d4c70-2b26-41bb-900e-21615a2b9163 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:52:55.971462 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-459d4c70-2b26-41bb-900e-21615a2b9163 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:55.971980 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-459d4c70-2b26-41bb-900e-21615a2b9163 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:55.972535 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-459d4c70-2b26-41bb-900e-21615a2b9163 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:55.974094 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-459d4c70-2b26-41bb-900e-21615a2b9163 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:55.974556 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-459d4c70-2b26-41bb-900e-21615a2b9163 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:55.974984 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-459d4c70-2b26-41bb-900e-21615a2b9163 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:56.106604 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-459d4c70-2b26-41bb-900e-21615a2b9163 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:52:56.114136 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-459d4c70-2b26-41bb-900e-21615a2b9163 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf" status: 200 len: 1680 microversion: 2.1 time: 0.153064 Aug 07 22:52:56.114693 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 533/1089] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:52:55 2022] GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:52:57.136496 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b2a16931-f0ee-4b22-a553-c23a7bdb92dd tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:52:57.137191 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-b2a16931-f0ee-4b22-a553-c23a7bdb92dd tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:52:57.143805 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b2a16931-f0ee-4b22-a553-c23a7bdb92dd tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:57.144308 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b2a16931-f0ee-4b22-a553-c23a7bdb92dd tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:57.144775 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b2a16931-f0ee-4b22-a553-c23a7bdb92dd tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:57.145573 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b2a16931-f0ee-4b22-a553-c23a7bdb92dd tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:57.146019 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b2a16931-f0ee-4b22-a553-c23a7bdb92dd tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:57.146440 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b2a16931-f0ee-4b22-a553-c23a7bdb92dd tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:57.277358 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-b2a16931-f0ee-4b22-a553-c23a7bdb92dd tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:52:57.284945 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-b2a16931-f0ee-4b22-a553-c23a7bdb92dd tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf" status: 200 len: 1680 microversion: 2.1 time: 0.152851 Aug 07 22:52:57.286043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 557/1090] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:52:57 2022] GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:52:58.306690 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-3b73c88a-72f0-4214-84fb-ad1b35b0ab64 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:52:58.307228 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-3b73c88a-72f0-4214-84fb-ad1b35b0ab64 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:52:58.313833 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3b73c88a-72f0-4214-84fb-ad1b35b0ab64 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:58.314308 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3b73c88a-72f0-4214-84fb-ad1b35b0ab64 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:58.314736 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3b73c88a-72f0-4214-84fb-ad1b35b0ab64 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:58.315422 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3b73c88a-72f0-4214-84fb-ad1b35b0ab64 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:58.315865 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3b73c88a-72f0-4214-84fb-ad1b35b0ab64 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:58.316309 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3b73c88a-72f0-4214-84fb-ad1b35b0ab64 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:58.398996 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-3b73c88a-72f0-4214-84fb-ad1b35b0ab64 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:52:58.406334 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-3b73c88a-72f0-4214-84fb-ad1b35b0ab64 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf" status: 200 len: 1613 microversion: 2.1 time: 0.103734 Aug 07 22:52:58.406897 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 534/1091] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:52:58 2022] GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf => generated 1613 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:52:58.647514 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-3fe162e7-561a-4b30-a47b-e637574979da req-a86f35a0-0ac7-4e8a-85f5-e824be2f29ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ab4ae6-8135-4ba5-8fff-4a25f284a1cf", "name": "network-vif-deleted", "tag": "478d29d3-847a-4d78-a000-ad4e54351799"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:52:58.657356 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-3fe162e7-561a-4b30-a47b-e637574979da req-a86f35a0-0ac7-4e8a-85f5-e824be2f29ab service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:58.657928 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-3fe162e7-561a-4b30-a47b-e637574979da req-a86f35a0-0ac7-4e8a-85f5-e824be2f29ab service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:58.658352 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-3fe162e7-561a-4b30-a47b-e637574979da req-a86f35a0-0ac7-4e8a-85f5-e824be2f29ab service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:58.672551 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-3fe162e7-561a-4b30-a47b-e637574979da req-a86f35a0-0ac7-4e8a-85f5-e824be2f29ab service nova] Creating event network-vif-deleted:478d29d3-847a-4d78-a000-ad4e54351799 for instance 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf on hv-cinder-85032 Aug 07 22:52:58.678938 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-3fe162e7-561a-4b30-a47b-e637574979da req-a86f35a0-0ac7-4e8a-85f5-e824be2f29ab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099559 Aug 07 22:52:58.679548 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 558/1092] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:52:59.429689 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ad977100-f588-4aec-ae42-29c8e66a73b8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:52:59.429689 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-ad977100-f588-4aec-ae42-29c8e66a73b8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:52:59.435068 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad977100-f588-4aec-ae42-29c8e66a73b8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:59.435550 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad977100-f588-4aec-ae42-29c8e66a73b8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:59.435985 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad977100-f588-4aec-ae42-29c8e66a73b8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:59.436805 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad977100-f588-4aec-ae42-29c8e66a73b8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:59.437325 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad977100-f588-4aec-ae42-29c8e66a73b8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:59.437751 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad977100-f588-4aec-ae42-29c8e66a73b8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:59.469612 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad977100-f588-4aec-ae42-29c8e66a73b8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:52:59.470090 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad977100-f588-4aec-ae42-29c8e66a73b8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:52:59.470524 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad977100-f588-4aec-ae42-29c8e66a73b8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:52:59.470999 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.objects.instance [None req-ad977100-f588-4aec-ae42-29c8e66a73b8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lazy-loading 'fault' on Instance uuid 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf {{(pid=129965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:52:59.525327 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-ad977100-f588-4aec-ae42-29c8e66a73b8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:52:59.535805 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-ad977100-f588-4aec-ae42-29c8e66a73b8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf" status: 200 len: 1331 microversion: 2.1 time: 0.111576 Aug 07 22:52:59.536443 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 535/1093] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:52:59 2022] GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf => generated 1331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:53:00.558088 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-e27222f5-fc3a-4f7e-94c7-074b70ba6d07 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:53:00.558833 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-e27222f5-fc3a-4f7e-94c7-074b70ba6d07 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:53:00.564908 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e27222f5-fc3a-4f7e-94c7-074b70ba6d07 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:00.565379 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e27222f5-fc3a-4f7e-94c7-074b70ba6d07 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:00.565815 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e27222f5-fc3a-4f7e-94c7-074b70ba6d07 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:00.566524 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e27222f5-fc3a-4f7e-94c7-074b70ba6d07 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:00.566969 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e27222f5-fc3a-4f7e-94c7-074b70ba6d07 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:00.567410 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-e27222f5-fc3a-4f7e-94c7-074b70ba6d07 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:00.580411 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-e27222f5-fc3a-4f7e-94c7-074b70ba6d07 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] HTTP exception thrown: Instance 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf could not be found. Aug 07 22:53:00.581998 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-e27222f5-fc3a-4f7e-94c7-074b70ba6d07 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Request method failure captured: Aug 07 22:53:00.581998 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf HTTP/1.1 Aug 07 22:53:00.581998 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:53:00.581998 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:53:00.581998 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:53:00.581998 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:53:00.581998 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:53:00.581998 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:53:00.581998 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:53:00.581998 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:53:00.581998 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8EGBVDt0B4T4NuqEVjly370CcefohZV8ujFPZ9aeuiXaRepQ4CoO-34qEEnDnCocUGVNEgiqPEON8F186gqTH91_Is0rvdIVNvdqPDy0X1A6jSCDPucnV0BigazZ7r8jyjsVUtC-BkDw2_ipoRYfpl4-MpZdfC7_1mPtbFtkdVE296w Aug 07 22:53:00.581998 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:53:00.581998 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:53:00.581998 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:53:00.581998 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:53:00.581998 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:53:00.581998 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:53:00.581998 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:53:00.581998 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:53:00.581998 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:53:00.581998 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:53:00.584331 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:53:00.584331 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:53:00.584331 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:53:00.584331 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:53:00.584331 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:53:00.584331 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:53:00.584331 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:53:00.584331 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: 13c06492c8db44759185686bd0a11a57 Aug 07 22:53:00.584331 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:53:00.584331 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: > Aug 07 22:53:00.584331 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Instance 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf could not be found. Aug 07 22:53:00.584331 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': '16ab4ae6-8135-4ba5-8fff-4a25f284a1cf'} Aug 07 22:53:00.585306 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:53:00.585306 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:53:00.585306 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:53:00.585306 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:53:00.585306 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:53:00.585306 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:53:00.585306 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:53:00.585306 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:53:00.585306 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:53:00.585306 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:53:00.585306 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf could not be found. Aug 07 22:53:00.585306 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:53:00.585306 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:53:00.585306 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:53:00.585306 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:53:00.585306 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:53:00.585306 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:53:00.585306 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:53:00.585306 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:53:00.585306 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:53:00.586902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:53:00.586902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:53:00.586902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:53:00.586902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:53:00.586902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:53:00.586902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:53:00.586902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:53:00.586902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf could not be found. Aug 07 22:53:00.586902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:53:00.586902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:53:00.586902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:53:00.586902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:53:00.586902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:53:00.586902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:53:00.586902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:53:00.586902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:53:00.586902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf could not be found. Aug 07 22:53:00.586902 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:53:00.588435 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-e27222f5-fc3a-4f7e-94c7-074b70ba6d07 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Returning 404 to user: Instance 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:53:00.588435 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-e27222f5-fc3a-4f7e-94c7-074b70ba6d07 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf" status: 404 len: 111 microversion: 2.1 time: 0.029942 Aug 07 22:53:00.588435 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 559/1094] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:53:00 2022] GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:53:00.592997 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-0c528932-a03a-4005-9dfd-3909a1cbdc06 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '.version_select at 0x7fc0ac6b2ca0>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:53:00.674513 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-0c528932-a03a-4005-9dfd-3909a1cbdc06 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1893146974" status: 202 len: 0 microversion: 2.1 time: 0.085298 Aug 07 22:53:00.675107 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 536/1095] 10.222.0.30 () {58 vars in 1221 bytes} [Sun Aug 7 22:53:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1893146974 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:53:01.459086 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-d3693895-bd97-4456-a56b-8a57bf1f7698 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Action: 'create', calling method: .version_select at 0x7fc09fd8fc10>, body: {"keypair": {"name": "tempest-keypair-2078482443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLo7Z3PimPtvBhMt3foprezzUSJBhiWKmjXCa8ktMZh92Vj0+J+y4y2d6QCep3/urS6uWEr8LNbpc65j9v9hxQpPy8fM8CO9qz6Ex1iv3Fh0MEfTGfRUonWTRGMZWrOn/A=="}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:53:01.474039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-d3693895-bd97-4456-a56b-8a57bf1f7698 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Getting quotas for project 4571d38eeff749fcb073842d5ad4fc65. Resources: {'key_pairs'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:53:01.478573 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.quota [None req-d3693895-bd97-4456-a56b-8a57bf1f7698 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Getting quotas for user 13c06492c8db44759185686bd0a11a57 and project 4571d38eeff749fcb073842d5ad4fc65. Resources: {'key_pairs'} {{(pid=129964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:53:01.571855 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-d3693895-bd97-4456-a56b-8a57bf1f7698 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.116633 Aug 07 22:53:01.572596 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 560/1096] 10.222.0.30 () {60 vars in 1159 bytes} [Sun Aug 7 22:53:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:53:03.644395 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-7bf4f8a9-67ec-4c22-a6f9-58fe144ed994 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-154124004", "imageRef": "91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d15b754-28f9-4d07-a0c7-ae4f93625ddd"}], "security_groups": [{"name": "tempest-securitygroup--741455178"}], "key_name": "tempest-keypair-2078482443", "user_data": "}} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:53:03.746969 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.network.neutron [None req-7bf4f8a9-67ec-4c22-a6f9-58fe144ed994 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] validate_networks() for [('2d15b754-28f9-4d07-a0c7-ae4f93625ddd', None, None, None, None, None)] {{(pid=129965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 22:53:04.107988 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-7bf4f8a9-67ec-4c22-a6f9-58fe144ed994 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Flavor limits 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 22:53:04.108434 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-7bf4f8a9-67ec-4c22-a6f9-58fe144ed994 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Image limits 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 22:53:04.108905 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-7bf4f8a9-67ec-4c22-a6f9-58fe144ed994 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Flavor pref 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 22:53:04.109311 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-7bf4f8a9-67ec-4c22-a6f9-58fe144ed994 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Image pref 0:0:0 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 22:53:04.109719 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.virt.hardware [None req-7bf4f8a9-67ec-4c22-a6f9-58fe144ed994 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 22:53:04.118967 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7bf4f8a9-67ec-4c22-a6f9-58fe144ed994 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:04.119500 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7bf4f8a9-67ec-4c22-a6f9-58fe144ed994 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:04.119873 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7bf4f8a9-67ec-4c22-a6f9-58fe144ed994 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:04.120706 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7bf4f8a9-67ec-4c22-a6f9-58fe144ed994 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:04.121159 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7bf4f8a9-67ec-4c22-a6f9-58fe144ed994 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:04.121579 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-7bf4f8a9-67ec-4c22-a6f9-58fe144ed994 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:04.138024 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-7bf4f8a9-67ec-4c22-a6f9-58fe144ed994 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Getting quotas for project 4571d38eeff749fcb073842d5ad4fc65. Resources: {'cores', 'instances', 'ram'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 22:53:04.142154 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.quota [None req-7bf4f8a9-67ec-4c22-a6f9-58fe144ed994 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Getting quotas for user 13c06492c8db44759185686bd0a11a57 and project 4571d38eeff749fcb073842d5ad4fc65. Resources: {'cores', 'instances', 'ram'} {{(pid=129965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 22:53:04.153650 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-7bf4f8a9-67ec-4c22-a6f9-58fe144ed994 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Going to run 1 instances... {{(pid=129965) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 22:53:04.155868 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-7bf4f8a9-67ec-4c22-a6f9-58fe144ed994 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91dfaa85-f3c0-43da-9f9f-bd8692b0c9c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 22:53:04.273642 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-7bf4f8a9-67ec-4c22-a6f9-58fe144ed994 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.633602 Aug 07 22:53:04.274304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 537/1097] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 22:53:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 22:53:04.285523 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-e22829b8-4fea-48b9-b3fe-730d05b3587d tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:53:04.286139 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-e22829b8-4fea-48b9-b3fe-730d05b3587d tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:53:04.341694 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-e22829b8-4fea-48b9-b3fe-730d05b3587d tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:53:04.349248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-e22829b8-4fea-48b9-b3fe-730d05b3587d tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b" status: 200 len: 1241 microversion: 2.1 time: 0.068017 Aug 07 22:53:04.350332 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 561/1098] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:53:04 2022] GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:53:05.371408 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-5f74e071-2614-4f91-9c43-c91314d53a65 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:53:05.372005 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-5f74e071-2614-4f91-9c43-c91314d53a65 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:53:05.378691 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5f74e071-2614-4f91-9c43-c91314d53a65 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:05.379209 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5f74e071-2614-4f91-9c43-c91314d53a65 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:05.379650 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5f74e071-2614-4f91-9c43-c91314d53a65 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:05.380533 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5f74e071-2614-4f91-9c43-c91314d53a65 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:05.381091 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5f74e071-2614-4f91-9c43-c91314d53a65 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:05.381522 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5f74e071-2614-4f91-9c43-c91314d53a65 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:05.448716 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-5f74e071-2614-4f91-9c43-c91314d53a65 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:53:05.456198 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-5f74e071-2614-4f91-9c43-c91314d53a65 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b" status: 200 len: 1237 microversion: 2.1 time: 0.089287 Aug 07 22:53:05.461620 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 538/1099] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:53:05 2022] GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b => generated 1237 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 22:53:06.478711 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-2fba6a8e-b5c8-402b-b90e-25fda36dc5c8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:53:06.479499 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-2fba6a8e-b5c8-402b-b90e-25fda36dc5c8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:53:06.486191 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2fba6a8e-b5c8-402b-b90e-25fda36dc5c8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:06.490301 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2fba6a8e-b5c8-402b-b90e-25fda36dc5c8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:06.490301 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2fba6a8e-b5c8-402b-b90e-25fda36dc5c8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:06.490301 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2fba6a8e-b5c8-402b-b90e-25fda36dc5c8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:06.490301 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2fba6a8e-b5c8-402b-b90e-25fda36dc5c8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:06.490720 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-2fba6a8e-b5c8-402b-b90e-25fda36dc5c8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:06.551739 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-2fba6a8e-b5c8-402b-b90e-25fda36dc5c8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:53:06.559714 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-2fba6a8e-b5c8-402b-b90e-25fda36dc5c8 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b" status: 200 len: 1311 microversion: 2.1 time: 0.085483 Aug 07 22:53:06.560307 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 562/1100] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:53:06 2022] GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b => generated 1311 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:53:07.581318 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-6839ce17-6c75-4d34-8911-30bbf3379a85 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:53:07.581946 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-6839ce17-6c75-4d34-8911-30bbf3379a85 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:53:07.588982 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6839ce17-6c75-4d34-8911-30bbf3379a85 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:07.589465 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6839ce17-6c75-4d34-8911-30bbf3379a85 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:07.589899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6839ce17-6c75-4d34-8911-30bbf3379a85 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:07.590587 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6839ce17-6c75-4d34-8911-30bbf3379a85 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:07.591033 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6839ce17-6c75-4d34-8911-30bbf3379a85 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:07.591452 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-6839ce17-6c75-4d34-8911-30bbf3379a85 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:07.730128 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-6839ce17-6c75-4d34-8911-30bbf3379a85 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:53:07.737619 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-6839ce17-6c75-4d34-8911-30bbf3379a85 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b" status: 200 len: 1366 microversion: 2.1 time: 0.160139 Aug 07 22:53:07.738186 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 539/1101] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:53:07 2022] GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:53:08.027132 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-fe0bab2a-fa50-44b2-9329-4a4da5755270 req-1d3971e2-6b30-47b1-8ac8-00160f75afa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac22b783-e5b8-4433-874b-6c5ccef5eb8b", "tag": "374b930a-c653-4543-968d-f5fcde3ad1df"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:53:08.037406 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-fe0bab2a-fa50-44b2-9329-4a4da5755270 req-1d3971e2-6b30-47b1-8ac8-00160f75afa1 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:08.037889 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-fe0bab2a-fa50-44b2-9329-4a4da5755270 req-1d3971e2-6b30-47b1-8ac8-00160f75afa1 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:08.038323 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-fe0bab2a-fa50-44b2-9329-4a4da5755270 req-1d3971e2-6b30-47b1-8ac8-00160f75afa1 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:08.049218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-fe0bab2a-fa50-44b2-9329-4a4da5755270 req-1d3971e2-6b30-47b1-8ac8-00160f75afa1 service nova] Creating event network-changed:374b930a-c653-4543-968d-f5fcde3ad1df for instance ac22b783-e5b8-4433-874b-6c5ccef5eb8b on hv-cinder-85032 Aug 07 22:53:08.054603 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-fe0bab2a-fa50-44b2-9329-4a4da5755270 req-1d3971e2-6b30-47b1-8ac8-00160f75afa1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032152 Aug 07 22:53:08.055198 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 563/1102] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:53:08.759919 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-77f345b4-245a-4b7d-8149-aebc7d913133 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:53:08.760633 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-77f345b4-245a-4b7d-8149-aebc7d913133 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:53:08.767350 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-77f345b4-245a-4b7d-8149-aebc7d913133 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:08.767831 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-77f345b4-245a-4b7d-8149-aebc7d913133 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:08.768299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-77f345b4-245a-4b7d-8149-aebc7d913133 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:08.769002 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-77f345b4-245a-4b7d-8149-aebc7d913133 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:08.769461 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-77f345b4-245a-4b7d-8149-aebc7d913133 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:08.769890 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-77f345b4-245a-4b7d-8149-aebc7d913133 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:08.900929 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-77f345b4-245a-4b7d-8149-aebc7d913133 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:53:08.907695 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-77f345b4-245a-4b7d-8149-aebc7d913133 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b" status: 200 len: 1366 microversion: 2.1 time: 0.151743 Aug 07 22:53:08.908282 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 540/1103] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:53:08 2022] GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:53:09.930130 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-bdd4f0fa-bf1b-4440-a113-d72ab8e54b59 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:53:09.930817 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-bdd4f0fa-bf1b-4440-a113-d72ab8e54b59 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:53:09.936991 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdd4f0fa-bf1b-4440-a113-d72ab8e54b59 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:09.937467 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdd4f0fa-bf1b-4440-a113-d72ab8e54b59 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:09.937899 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdd4f0fa-bf1b-4440-a113-d72ab8e54b59 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:09.938581 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdd4f0fa-bf1b-4440-a113-d72ab8e54b59 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:09.939026 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdd4f0fa-bf1b-4440-a113-d72ab8e54b59 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:09.939445 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bdd4f0fa-bf1b-4440-a113-d72ab8e54b59 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:10.070394 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-bdd4f0fa-bf1b-4440-a113-d72ab8e54b59 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:53:10.077681 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-bdd4f0fa-bf1b-4440-a113-d72ab8e54b59 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b" status: 200 len: 1366 microversion: 2.1 time: 0.152883 Aug 07 22:53:10.078243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 564/1104] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:53:09 2022] GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:53:11.098532 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-321856db-e52e-4f70-ba8b-12371f99a1a2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:53:11.099775 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-321856db-e52e-4f70-ba8b-12371f99a1a2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:53:11.106909 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-321856db-e52e-4f70-ba8b-12371f99a1a2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:11.107386 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-321856db-e52e-4f70-ba8b-12371f99a1a2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:11.107819 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-321856db-e52e-4f70-ba8b-12371f99a1a2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:11.108624 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-321856db-e52e-4f70-ba8b-12371f99a1a2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:11.109076 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-321856db-e52e-4f70-ba8b-12371f99a1a2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:11.109501 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-321856db-e52e-4f70-ba8b-12371f99a1a2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:11.238685 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-321856db-e52e-4f70-ba8b-12371f99a1a2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:53:11.246291 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-321856db-e52e-4f70-ba8b-12371f99a1a2 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b" status: 200 len: 1366 microversion: 2.1 time: 0.151639 Aug 07 22:53:11.246952 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 541/1105] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:53:11 2022] GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:53:12.267793 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-0fc69e4b-31a8-4342-b223-168f1630c54e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:53:12.268434 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-0fc69e4b-31a8-4342-b223-168f1630c54e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:53:12.275590 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0fc69e4b-31a8-4342-b223-168f1630c54e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:12.276094 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0fc69e4b-31a8-4342-b223-168f1630c54e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:12.276529 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0fc69e4b-31a8-4342-b223-168f1630c54e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:12.277214 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0fc69e4b-31a8-4342-b223-168f1630c54e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:12.277672 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0fc69e4b-31a8-4342-b223-168f1630c54e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:12.278098 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-0fc69e4b-31a8-4342-b223-168f1630c54e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:12.407416 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-0fc69e4b-31a8-4342-b223-168f1630c54e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:53:12.415412 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-0fc69e4b-31a8-4342-b223-168f1630c54e tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b" status: 200 len: 1366 microversion: 2.1 time: 0.151787 Aug 07 22:53:12.415974 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 565/1106] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:53:12 2022] GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:53:12.890261 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [req-05a24348-c884-4abd-8e6c-2b05146b1bcf req-43484fd2-5ebc-4700-9524-c73a7fe09863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac22b783-e5b8-4433-874b-6c5ccef5eb8b", "name": "network-vif-plugged", "status": "completed", "tag": "374b930a-c653-4543-968d-f5fcde3ad1df"}]} {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:53:12.901105 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-05a24348-c884-4abd-8e6c-2b05146b1bcf req-43484fd2-5ebc-4700-9524-c73a7fe09863 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:12.901581 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-05a24348-c884-4abd-8e6c-2b05146b1bcf req-43484fd2-5ebc-4700-9524-c73a7fe09863 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:12.902012 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [req-05a24348-c884-4abd-8e6c-2b05146b1bcf req-43484fd2-5ebc-4700-9524-c73a7fe09863 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:12.912628 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.compute.server_external_events [req-05a24348-c884-4abd-8e6c-2b05146b1bcf req-43484fd2-5ebc-4700-9524-c73a7fe09863 service nova] Creating event network-vif-plugged:374b930a-c653-4543-968d-f5fcde3ad1df for instance ac22b783-e5b8-4433-874b-6c5ccef5eb8b on hv-cinder-85032 Aug 07 22:53:12.917502 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [req-05a24348-c884-4abd-8e6c-2b05146b1bcf req-43484fd2-5ebc-4700-9524-c73a7fe09863 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030935 Aug 07 22:53:12.918075 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 542/1107] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:53:13.436024 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-366592d8-7021-4486-93cb-2416d2bce4ff tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:53:13.436661 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-366592d8-7021-4486-93cb-2416d2bce4ff tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:53:13.443054 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-366592d8-7021-4486-93cb-2416d2bce4ff tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:13.443532 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-366592d8-7021-4486-93cb-2416d2bce4ff tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:13.446303 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-366592d8-7021-4486-93cb-2416d2bce4ff tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:13.446303 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-366592d8-7021-4486-93cb-2416d2bce4ff tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:13.446303 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-366592d8-7021-4486-93cb-2416d2bce4ff tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:13.446303 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-366592d8-7021-4486-93cb-2416d2bce4ff tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:13.574243 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-366592d8-7021-4486-93cb-2416d2bce4ff tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:53:13.581682 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-366592d8-7021-4486-93cb-2416d2bce4ff tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b" status: 200 len: 1366 microversion: 2.1 time: 0.149509 Aug 07 22:53:13.582231 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 566/1108] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:53:13 2022] GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:53:14.599688 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=2 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:53:14.601205 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell0:SELECT=6 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:53:14.605590 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-8076f21e-a6b3-458e-ab93-1d36508ac5ec tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:53:14.606296 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-8076f21e-a6b3-458e-ab93-1d36508ac5ec tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:53:14.612475 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8076f21e-a6b3-458e-ab93-1d36508ac5ec tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:14.613116 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8076f21e-a6b3-458e-ab93-1d36508ac5ec tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:14.613565 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8076f21e-a6b3-458e-ab93-1d36508ac5ec tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:14.614260 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8076f21e-a6b3-458e-ab93-1d36508ac5ec tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:14.614723 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8076f21e-a6b3-458e-ab93-1d36508ac5ec tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:14.615148 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-8076f21e-a6b3-458e-ab93-1d36508ac5ec tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:14.752788 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-8076f21e-a6b3-458e-ab93-1d36508ac5ec tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:53:14.760399 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-8076f21e-a6b3-458e-ab93-1d36508ac5ec tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b" status: 200 len: 1366 microversion: 2.1 time: 0.162107 Aug 07 22:53:14.760954 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 543/1109] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:53:14 2022] GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:53:15.781631 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-c7eaf10c-b880-4e66-8fa8-8fd3691292cf tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:53:15.782259 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-c7eaf10c-b880-4e66-8fa8-8fd3691292cf tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:53:15.784253 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell0:SELECT=6 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:53:15.789967 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c7eaf10c-b880-4e66-8fa8-8fd3691292cf tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:15.790449 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c7eaf10c-b880-4e66-8fa8-8fd3691292cf tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:15.790887 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c7eaf10c-b880-4e66-8fa8-8fd3691292cf tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:15.791608 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c7eaf10c-b880-4e66-8fa8-8fd3691292cf tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:15.792116 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c7eaf10c-b880-4e66-8fa8-8fd3691292cf tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:15.793406 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-c7eaf10c-b880-4e66-8fa8-8fd3691292cf tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:15.922062 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-c7eaf10c-b880-4e66-8fa8-8fd3691292cf tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:53:15.930138 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-c7eaf10c-b880-4e66-8fa8-8fd3691292cf tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b" status: 200 len: 1555 microversion: 2.1 time: 0.152526 Aug 07 22:53:15.930701 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 567/1110] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:53:15 2022] GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:53:15.950665 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-ad4ff252-33d6-45d6-85d3-a92487e8db45 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:53:15.951164 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-ad4ff252-33d6-45d6-85d3-a92487e8db45 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:53:15.953532 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:53:15.958184 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad4ff252-33d6-45d6-85d3-a92487e8db45 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:15.958664 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad4ff252-33d6-45d6-85d3-a92487e8db45 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:15.959099 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad4ff252-33d6-45d6-85d3-a92487e8db45 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:15.960513 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad4ff252-33d6-45d6-85d3-a92487e8db45 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:15.961066 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad4ff252-33d6-45d6-85d3-a92487e8db45 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:15.961493 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-ad4ff252-33d6-45d6-85d3-a92487e8db45 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:15.963830 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:53:16.040270 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-ad4ff252-33d6-45d6-85d3-a92487e8db45 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093347 Aug 07 22:53:16.040861 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 544/1111] 10.222.0.30 () {58 vars in 1275 bytes} [Sun Aug 7 22:53:15 2022] GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:53:17.316174 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-6989cbb3-a108-427c-a8cd-76dca3ce7ced req-f93fd2be-d36c-43ee-9d6c-c7e2a840b6cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac22b783-e5b8-4433-874b-6c5ccef5eb8b", "tag": "374b930a-c653-4543-968d-f5fcde3ad1df"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:53:17.326510 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-6989cbb3-a108-427c-a8cd-76dca3ce7ced req-f93fd2be-d36c-43ee-9d6c-c7e2a840b6cd service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:17.326980 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-6989cbb3-a108-427c-a8cd-76dca3ce7ced req-f93fd2be-d36c-43ee-9d6c-c7e2a840b6cd service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:17.327412 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-6989cbb3-a108-427c-a8cd-76dca3ce7ced req-f93fd2be-d36c-43ee-9d6c-c7e2a840b6cd service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:17.339001 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-6989cbb3-a108-427c-a8cd-76dca3ce7ced req-f93fd2be-d36c-43ee-9d6c-c7e2a840b6cd service nova] Creating event network-changed:374b930a-c653-4543-968d-f5fcde3ad1df for instance ac22b783-e5b8-4433-874b-6c5ccef5eb8b on hv-cinder-85032 Aug 07 22:53:17.343985 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-6989cbb3-a108-427c-a8cd-76dca3ce7ced req-f93fd2be-d36c-43ee-9d6c-c7e2a840b6cd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031481 Aug 07 22:53:17.348953 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 568/1112] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:53:52.109816 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-abe290e1-0db9-4cde-b3c0-96be3ecff457 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:53:52.110424 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-abe290e1-0db9-4cde-b3c0-96be3ecff457 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:53:52.117037 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-abe290e1-0db9-4cde-b3c0-96be3ecff457 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:52.117510 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-abe290e1-0db9-4cde-b3c0-96be3ecff457 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:52.117938 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-abe290e1-0db9-4cde-b3c0-96be3ecff457 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:52.119164 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-abe290e1-0db9-4cde-b3c0-96be3ecff457 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:52.119606 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-abe290e1-0db9-4cde-b3c0-96be3ecff457 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:52.120033 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-abe290e1-0db9-4cde-b3c0-96be3ecff457 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:52.143395 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-abe290e1-0db9-4cde-b3c0-96be3ecff457 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b/ips" status: 200 len: 149 microversion: 2.1 time: 0.039049 Aug 07 22:53:52.143986 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 545/1113] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Aug 7 22:53:52 2022] GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:53:53.742680 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:53:53.743522 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG dbcounter [-] [129964] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:53:53.747728 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-83cda571-c7ca-4d3a-a665-f4a046254065 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98d72e41-e97d-45d5-96d7-d1cccf53c48a"}} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:53:53.750121 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-83cda571-c7ca-4d3a-a665-f4a046254065 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:53:53.756008 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-83cda571-c7ca-4d3a-a665-f4a046254065 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:53.756505 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-83cda571-c7ca-4d3a-a665-f4a046254065 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:53.756946 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-83cda571-c7ca-4d3a-a665-f4a046254065 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:53.757633 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-83cda571-c7ca-4d3a-a665-f4a046254065 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:53:53.758082 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-83cda571-c7ca-4d3a-a665-f4a046254065 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:53:53.758504 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-83cda571-c7ca-4d3a-a665-f4a046254065 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:53:54.569072 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-83cda571-c7ca-4d3a-a665-f4a046254065 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "POST /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.827675 Aug 07 22:53:54.569670 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 569/1114] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 22:53:53 2022] POST /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b/os-volume_attachments => generated 194 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:54:02.203535 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-cc800543-43b1-4c8c-94c8-9e48987a61de tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:54:02.204096 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-cc800543-43b1-4c8c-94c8-9e48987a61de tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:54:02.205949 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG dbcounter [-] [129965] Writing DB stats nova_api:SELECT=3 {{(pid=129965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 22:54:02.210773 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cc800543-43b1-4c8c-94c8-9e48987a61de tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:02.211243 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cc800543-43b1-4c8c-94c8-9e48987a61de tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:02.211675 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cc800543-43b1-4c8c-94c8-9e48987a61de tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:02.212382 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cc800543-43b1-4c8c-94c8-9e48987a61de tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:02.212835 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cc800543-43b1-4c8c-94c8-9e48987a61de tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:02.213309 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-cc800543-43b1-4c8c-94c8-9e48987a61de tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:02.292524 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.objects.instance [None req-cc800543-43b1-4c8c-94c8-9e48987a61de tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lazy-loading 'services' on Instance uuid ac22b783-e5b8-4433-874b-6c5ccef5eb8b {{(pid=129965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:54:02.490508 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-cc800543-43b1-4c8c-94c8-9e48987a61de tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b/os-volume_attachments/98d72e41-e97d-45d5-96d7-d1cccf53c48a" status: 202 len: 0 microversion: 2.1 time: 0.291272 Aug 07 22:54:02.491116 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 546/1115] 10.222.0.30 () {58 vars in 1416 bytes} [Sun Aug 7 22:54:02 2022] DELETE /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b/os-volume_attachments/98d72e41-e97d-45d5-96d7-d1cccf53c48a => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 22:54:02.501963 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-afad6c6e-0aa1-475f-ad17-fa89621ff051 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:54:02.502630 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-afad6c6e-0aa1-475f-ad17-fa89621ff051 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:54:02.509359 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-afad6c6e-0aa1-475f-ad17-fa89621ff051 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:02.509908 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-afad6c6e-0aa1-475f-ad17-fa89621ff051 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:02.510353 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-afad6c6e-0aa1-475f-ad17-fa89621ff051 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:02.511049 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-afad6c6e-0aa1-475f-ad17-fa89621ff051 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:02.511526 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-afad6c6e-0aa1-475f-ad17-fa89621ff051 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:02.511949 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-afad6c6e-0aa1-475f-ad17-fa89621ff051 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:02.542814 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-afad6c6e-0aa1-475f-ad17-fa89621ff051 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047004 Aug 07 22:54:02.543374 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 570/1116] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 22:54:02 2022] GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:54:03.555652 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-3903260e-e292-46f3-ab35-02f879b1a71a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:54:03.558610 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-3903260e-e292-46f3-ab35-02f879b1a71a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:54:03.565340 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3903260e-e292-46f3-ab35-02f879b1a71a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:03.572351 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3903260e-e292-46f3-ab35-02f879b1a71a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:03.572351 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3903260e-e292-46f3-ab35-02f879b1a71a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:03.572351 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3903260e-e292-46f3-ab35-02f879b1a71a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:03.572351 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3903260e-e292-46f3-ab35-02f879b1a71a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:03.572857 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-3903260e-e292-46f3-ab35-02f879b1a71a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:03.597414 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-3903260e-e292-46f3-ab35-02f879b1a71a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046252 Aug 07 22:54:03.598165 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 547/1117] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 22:54:03 2022] GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 22:54:03.664743 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-bbe28ef7-a5a5-4a1e-bdd3-f3e58bc6a794 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:54:03.665257 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-bbe28ef7-a5a5-4a1e-bdd3-f3e58bc6a794 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:54:03.672763 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bbe28ef7-a5a5-4a1e-bdd3-f3e58bc6a794 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:03.674450 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bbe28ef7-a5a5-4a1e-bdd3-f3e58bc6a794 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:03.674450 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bbe28ef7-a5a5-4a1e-bdd3-f3e58bc6a794 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:03.674450 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bbe28ef7-a5a5-4a1e-bdd3-f3e58bc6a794 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:03.674450 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bbe28ef7-a5a5-4a1e-bdd3-f3e58bc6a794 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:03.675548 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-bbe28ef7-a5a5-4a1e-bdd3-f3e58bc6a794 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:03.702903 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-bbe28ef7-a5a5-4a1e-bdd3-f3e58bc6a794 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] Going to try to terminate instance {{(pid=129964) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 22:54:03.976751 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-bbe28ef7-a5a5-4a1e-bdd3-f3e58bc6a794 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b" status: 204 len: 0 microversion: 2.1 time: 0.315533 Aug 07 22:54:03.977352 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 571/1118] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:54:03 2022] DELETE /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 22:54:03.986416 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-87f896bc-389d-4668-acff-efb76175ab8a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:54:03.989172 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-87f896bc-389d-4668-acff-efb76175ab8a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:54:03.993299 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-87f896bc-389d-4668-acff-efb76175ab8a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:03.993779 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-87f896bc-389d-4668-acff-efb76175ab8a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:03.994267 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-87f896bc-389d-4668-acff-efb76175ab8a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:03.994958 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-87f896bc-389d-4668-acff-efb76175ab8a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:03.995414 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-87f896bc-389d-4668-acff-efb76175ab8a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:03.995839 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-87f896bc-389d-4668-acff-efb76175ab8a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:04.128854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-87f896bc-389d-4668-acff-efb76175ab8a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:54:04.136385 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-87f896bc-389d-4668-acff-efb76175ab8a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b" status: 200 len: 1680 microversion: 2.1 time: 0.153837 Aug 07 22:54:04.136941 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 548/1119] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:54:03 2022] GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:54:05.157673 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-38bcf4d7-1139-49f0-b117-381046033c3a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:54:05.158388 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-38bcf4d7-1139-49f0-b117-381046033c3a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:54:05.164748 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-38bcf4d7-1139-49f0-b117-381046033c3a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:05.165228 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-38bcf4d7-1139-49f0-b117-381046033c3a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:05.165659 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-38bcf4d7-1139-49f0-b117-381046033c3a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:05.166873 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-38bcf4d7-1139-49f0-b117-381046033c3a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:05.167320 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-38bcf4d7-1139-49f0-b117-381046033c3a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:05.167740 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-38bcf4d7-1139-49f0-b117-381046033c3a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:05.295897 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.policy [None req-38bcf4d7-1139-49f0-b117-381046033c3a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129964) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:54:05.303302 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-38bcf4d7-1139-49f0-b117-381046033c3a tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b" status: 200 len: 1680 microversion: 2.1 time: 0.149967 Aug 07 22:54:05.303925 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 572/1120] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:54:05 2022] GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:54:06.325883 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-02447527-2760-4b1b-be49-a2175d541293 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:54:06.326505 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-02447527-2760-4b1b-be49-a2175d541293 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:54:06.332922 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-02447527-2760-4b1b-be49-a2175d541293 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:06.333400 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-02447527-2760-4b1b-be49-a2175d541293 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:06.333833 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-02447527-2760-4b1b-be49-a2175d541293 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:06.334522 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-02447527-2760-4b1b-be49-a2175d541293 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:06.334972 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-02447527-2760-4b1b-be49-a2175d541293 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:06.335556 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-02447527-2760-4b1b-be49-a2175d541293 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:06.438676 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-02447527-2760-4b1b-be49-a2175d541293 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:54:06.446294 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-02447527-2760-4b1b-be49-a2175d541293 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b" status: 200 len: 1613 microversion: 2.1 time: 0.124901 Aug 07 22:54:06.447814 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 549/1121] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:54:06 2022] GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b => generated 1613 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:54:06.674641 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [req-f16936c9-d4eb-4e9d-b8e1-e537d13e5a89 req-efff42b1-17e9-4eac-9fb6-ef8b74d237f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac22b783-e5b8-4433-874b-6c5ccef5eb8b", "name": "network-vif-deleted", "tag": "374b930a-c653-4543-968d-f5fcde3ad1df"}]} {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 22:54:06.686574 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-f16936c9-d4eb-4e9d-b8e1-e537d13e5a89 req-efff42b1-17e9-4eac-9fb6-ef8b74d237f2 service nova] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:06.687364 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-f16936c9-d4eb-4e9d-b8e1-e537d13e5a89 req-efff42b1-17e9-4eac-9fb6-ef8b74d237f2 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:06.688287 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [req-f16936c9-d4eb-4e9d-b8e1-e537d13e5a89 req-efff42b1-17e9-4eac-9fb6-ef8b74d237f2 service nova] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:06.703981 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.compute.server_external_events [req-f16936c9-d4eb-4e9d-b8e1-e537d13e5a89 req-efff42b1-17e9-4eac-9fb6-ef8b74d237f2 service nova] Creating event network-vif-deleted:374b930a-c653-4543-968d-f5fcde3ad1df for instance ac22b783-e5b8-4433-874b-6c5ccef5eb8b on hv-cinder-85032 Aug 07 22:54:06.708944 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [req-f16936c9-d4eb-4e9d-b8e1-e537d13e5a89 req-efff42b1-17e9-4eac-9fb6-ef8b74d237f2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038311 Aug 07 22:54:06.709540 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 573/1122] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 22:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 22:54:07.467895 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-1808114c-dd57-4dfe-8b22-c917ef9db6b1 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:54:07.468546 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-1808114c-dd57-4dfe-8b22-c917ef9db6b1 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:54:07.475305 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1808114c-dd57-4dfe-8b22-c917ef9db6b1 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:07.475922 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1808114c-dd57-4dfe-8b22-c917ef9db6b1 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:07.476478 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1808114c-dd57-4dfe-8b22-c917ef9db6b1 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:07.477199 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1808114c-dd57-4dfe-8b22-c917ef9db6b1 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:07.477694 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1808114c-dd57-4dfe-8b22-c917ef9db6b1 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:07.478756 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1808114c-dd57-4dfe-8b22-c917ef9db6b1 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:07.512367 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1808114c-dd57-4dfe-8b22-c917ef9db6b1 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:07.512860 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1808114c-dd57-4dfe-8b22-c917ef9db6b1 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:07.513922 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-1808114c-dd57-4dfe-8b22-c917ef9db6b1 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:07.514387 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.objects.instance [None req-1808114c-dd57-4dfe-8b22-c917ef9db6b1 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lazy-loading 'fault' on Instance uuid ac22b783-e5b8-4433-874b-6c5ccef5eb8b {{(pid=129965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 22:54:07.559071 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.policy [None req-1808114c-dd57-4dfe-8b22-c917ef9db6b1 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c06492c8db44759185686bd0a11a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4571d38eeff749fcb073842d5ad4fc65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129965) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 22:54:07.568844 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-1808114c-dd57-4dfe-8b22-c917ef9db6b1 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b" status: 200 len: 1331 microversion: 2.1 time: 0.104904 Aug 07 22:54:07.575030 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 550/1123] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:54:07 2022] GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 22:54:08.592342 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b500755a-bc3a-4daf-b694-4b4e76646598 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:54:08.593075 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-b500755a-bc3a-4daf-b694-4b4e76646598 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:54:08.599186 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b500755a-bc3a-4daf-b694-4b4e76646598 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:08.599665 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b500755a-bc3a-4daf-b694-4b4e76646598 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:08.600130 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b500755a-bc3a-4daf-b694-4b4e76646598 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:08.600823 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b500755a-bc3a-4daf-b694-4b4e76646598 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:08.601277 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b500755a-bc3a-4daf-b694-4b4e76646598 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:08.601702 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-b500755a-bc3a-4daf-b694-4b4e76646598 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:08.615768 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-b500755a-bc3a-4daf-b694-4b4e76646598 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] HTTP exception thrown: Instance ac22b783-e5b8-4433-874b-6c5ccef5eb8b could not be found. Aug 07 22:54:08.617404 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b500755a-bc3a-4daf-b694-4b4e76646598 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Request method failure captured: Aug 07 22:54:08.617404 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b HTTP/1.1 Aug 07 22:54:08.617404 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:54:08.617404 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:54:08.617404 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:54:08.617404 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:54:08.617404 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:54:08.617404 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:54:08.617404 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:54:08.617404 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:54:08.617404 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8EGBVDt0B4T4NuqEVjly370CcefohZV8ujFPZ9aeuiXaRepQ4CoO-34qEEnDnCocUGVNEgiqPEON8F186gqTH91_Is0rvdIVNvdqPDy0X1A6jSCDPucnV0BigazZ7r8jyjsVUtC-BkDw2_ipoRYfpl4-MpZdfC7_1mPtbFtkdVE296w Aug 07 22:54:08.617404 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:54:08.617404 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:54:08.617404 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:54:08.617404 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:54:08.617404 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:54:08.617404 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:54:08.617404 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:54:08.617404 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:08.617404 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:54:08.617404 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:54:08.619251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:54:08.619251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:08.619251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:54:08.619251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:08.619251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:54:08.619251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:54:08.619251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:54:08.619251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: 13c06492c8db44759185686bd0a11a57 Aug 07 22:54:08.619251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:54:08.619251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: > Aug 07 22:54:08.619251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Instance ac22b783-e5b8-4433-874b-6c5ccef5eb8b could not be found. Aug 07 22:54:08.619251 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': 'ac22b783-e5b8-4433-874b-6c5ccef5eb8b'} Aug 07 22:54:08.620479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:54:08.620479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:08.620479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:54:08.620479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:54:08.620479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:54:08.620479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:54:08.620479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:54:08.620479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:54:08.620479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:54:08.620479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:54:08.620479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac22b783-e5b8-4433-874b-6c5ccef5eb8b could not be found. Aug 07 22:54:08.620479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:54:08.620479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:54:08.620479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:54:08.620479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:08.620479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:54:08.620479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:54:08.620479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:54:08.620479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:54:08.620479 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:54:08.622164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:54:08.622164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:54:08.622164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:54:08.622164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:54:08.622164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:54:08.622164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:54:08.622164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:54:08.622164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac22b783-e5b8-4433-874b-6c5ccef5eb8b could not be found. Aug 07 22:54:08.622164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:54:08.622164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:54:08.622164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:54:08.622164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:08.622164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:54:08.622164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:54:08.622164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:54:08.622164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:54:08.622164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac22b783-e5b8-4433-874b-6c5ccef5eb8b could not be found. Aug 07 22:54:08.622164 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:54:08.623744 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-b500755a-bc3a-4daf-b694-4b4e76646598 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Returning 404 to user: Instance ac22b783-e5b8-4433-874b-6c5ccef5eb8b could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:54:08.623744 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-b500755a-bc3a-4daf-b694-4b4e76646598 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b" status: 404 len: 111 microversion: 2.1 time: 0.032037 Aug 07 22:54:08.623744 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 574/1124] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:54:08 2022] GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:54:08.627947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-c678ead1-40ae-480c-8c54-63dd4f08d99f tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '.version_select at 0x7fc0ac51f820>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:54:08.707923 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-c678ead1-40ae-480c-8c54-63dd4f08d99f tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2078482443" status: 202 len: 0 microversion: 2.1 time: 0.083826 Aug 07 22:54:08.708524 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 551/1125] 10.222.0.30 () {58 vars in 1221 bytes} [Sun Aug 7 22:54:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2078482443 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 22:54:10.758156 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-02209638-2d66-44f7-be82-0b2b7e351a44 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:54:10.758634 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-02209638-2d66-44f7-be82-0b2b7e351a44 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:54:10.765080 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-02209638-2d66-44f7-be82-0b2b7e351a44 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:10.765566 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-02209638-2d66-44f7-be82-0b2b7e351a44 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:10.766005 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-02209638-2d66-44f7-be82-0b2b7e351a44 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:10.766697 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-02209638-2d66-44f7-be82-0b2b7e351a44 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:10.767156 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-02209638-2d66-44f7-be82-0b2b7e351a44 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:10.767827 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-02209638-2d66-44f7-be82-0b2b7e351a44 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:10.781828 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-02209638-2d66-44f7-be82-0b2b7e351a44 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] HTTP exception thrown: Instance ac22b783-e5b8-4433-874b-6c5ccef5eb8b could not be found. Aug 07 22:54:10.783386 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-02209638-2d66-44f7-be82-0b2b7e351a44 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Request method failure captured: Aug 07 22:54:10.783386 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: DELETE /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b HTTP/1.1 Aug 07 22:54:10.783386 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:54:10.783386 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:54:10.783386 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:54:10.783386 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:54:10.783386 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:54:10.783386 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:54:10.783386 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:54:10.783386 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:54:10.783386 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8EGBVDt0B4T4NuqEVjly370CcefohZV8ujFPZ9aeuiXaRepQ4CoO-34qEEnDnCocUGVNEgiqPEON8F186gqTH91_Is0rvdIVNvdqPDy0X1A6jSCDPucnV0BigazZ7r8jyjsVUtC-BkDw2_ipoRYfpl4-MpZdfC7_1mPtbFtkdVE296w Aug 07 22:54:10.783386 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:54:10.783386 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:54:10.783386 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:54:10.783386 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:54:10.783386 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:54:10.783386 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:54:10.783386 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:54:10.783386 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:10.783386 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:54:10.783386 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:54:10.785182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:54:10.785182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:10.785182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:54:10.785182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:10.785182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:54:10.785182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:54:10.785182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:54:10.785182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: 13c06492c8db44759185686bd0a11a57 Aug 07 22:54:10.785182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:54:10.785182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: > Aug 07 22:54:10.785182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Instance ac22b783-e5b8-4433-874b-6c5ccef5eb8b could not be found. Aug 07 22:54:10.785182 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': 'ac22b783-e5b8-4433-874b-6c5ccef5eb8b'} Aug 07 22:54:10.786329 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:54:10.786329 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:10.786329 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:54:10.786329 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:54:10.786329 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:54:10.786329 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:54:10.786329 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:54:10.786329 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:54:10.786329 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:54:10.786329 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:54:10.786329 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac22b783-e5b8-4433-874b-6c5ccef5eb8b could not be found. Aug 07 22:54:10.786329 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:54:10.786329 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:54:10.786329 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:54:10.786329 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:10.786329 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:54:10.786329 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:54:10.786329 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:54:10.786329 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:54:10.786329 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:54:10.788043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:54:10.788043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 22:54:10.788043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 22:54:10.788043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 22:54:10.788043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 22:54:10.788043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:54:10.788043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:54:10.788043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:54:10.788043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:54:10.788043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac22b783-e5b8-4433-874b-6c5ccef5eb8b could not be found. Aug 07 22:54:10.788043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:54:10.788043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:54:10.788043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:54:10.788043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:10.788043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:54:10.788043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:54:10.788043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:54:10.788043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:54:10.788043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac22b783-e5b8-4433-874b-6c5ccef5eb8b could not be found. Aug 07 22:54:10.788043 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:54:10.789652 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-02209638-2d66-44f7-be82-0b2b7e351a44 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Returning 404 to user: Instance ac22b783-e5b8-4433-874b-6c5ccef5eb8b could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:54:10.789652 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-02209638-2d66-44f7-be82-0b2b7e351a44 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b" status: 404 len: 111 microversion: 2.1 time: 0.030578 Aug 07 22:54:10.789652 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 575/1126] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:54:10 2022] DELETE /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:54:10.793975 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d0653083-ecd2-4330-b999-04bf35dd02b7 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:54:10.794603 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-d0653083-ecd2-4330-b999-04bf35dd02b7 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: ac22b783-e5b8-4433-874b-6c5ccef5eb8b] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:54:10.801559 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d0653083-ecd2-4330-b999-04bf35dd02b7 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:10.802030 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d0653083-ecd2-4330-b999-04bf35dd02b7 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:10.802459 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d0653083-ecd2-4330-b999-04bf35dd02b7 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:10.803134 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d0653083-ecd2-4330-b999-04bf35dd02b7 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:10.803607 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d0653083-ecd2-4330-b999-04bf35dd02b7 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:10.804046 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-d0653083-ecd2-4330-b999-04bf35dd02b7 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:10.816786 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.wsgi [None req-d0653083-ecd2-4330-b999-04bf35dd02b7 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] HTTP exception thrown: Instance ac22b783-e5b8-4433-874b-6c5ccef5eb8b could not be found. Aug 07 22:54:10.818396 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d0653083-ecd2-4330-b999-04bf35dd02b7 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Request method failure captured: Aug 07 22:54:10.818396 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: request: GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b HTTP/1.1 Aug 07 22:54:10.818396 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept: application/json Aug 07 22:54:10.818396 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept-Encoding: identity Aug 07 22:54:10.818396 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Connection: close Aug 07 22:54:10.818396 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Length: 0 Aug 07 22:54:10.818396 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Type: application/json Aug 07 22:54:10.818396 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Host: 10.222.0.30 Aug 07 22:54:10.818396 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Openstack-System-Scope: None Aug 07 22:54:10.818396 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: User-Agent: python-urllib3/1.26.11 Aug 07 22:54:10.818396 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Auth-Token: gAAAAABi8EGBVDt0B4T4NuqEVjly370CcefohZV8ujFPZ9aeuiXaRepQ4CoO-34qEEnDnCocUGVNEgiqPEON8F186gqTH91_Is0rvdIVNvdqPDy0X1A6jSCDPucnV0BigazZ7r8jyjsVUtC-BkDw2_ipoRYfpl4-MpZdfC7_1mPtbFtkdVE296w Aug 07 22:54:10.818396 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Id: None Aug 07 22:54:10.818396 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Name: None Aug 07 22:54:10.818396 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Identity-Status: Confirmed Aug 07 22:54:10.818396 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Is-Admin-Project: True Aug 07 22:54:10.818396 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Id: default Aug 07 22:54:10.818396 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Name: Default Aug 07 22:54:10.818396 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:54:10.818396 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:10.818396 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Role: reader,member Aug 07 22:54:10.818396 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Roles: reader,member Aug 07 22:54:10.820173 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:54:10.820173 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:10.820173 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:54:10.820173 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:10.820173 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:54:10.820173 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Id: default Aug 07 22:54:10.820173 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Name: Default Aug 07 22:54:10.820173 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Id: 13c06492c8db44759185686bd0a11a57 Aug 07 22:54:10.820173 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Name: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:54:10.820173 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: method: > Aug 07 22:54:10.820173 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: exception: Instance ac22b783-e5b8-4433-874b-6c5ccef5eb8b could not be found. Aug 07 22:54:10.820173 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: action_args: {'id': 'ac22b783-e5b8-4433-874b-6c5ccef5eb8b'} Aug 07 22:54:10.821304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:54:10.821304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:10.821304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:54:10.821304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:54:10.821304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:54:10.821304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:54:10.821304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:54:10.821304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:54:10.821304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:54:10.821304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:54:10.821304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac22b783-e5b8-4433-874b-6c5ccef5eb8b could not be found. Aug 07 22:54:10.821304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:54:10.821304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:54:10.821304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:54:10.821304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:10.821304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:54:10.821304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:54:10.821304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:54:10.821304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:54:10.821304 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:54:10.822899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:54:10.822899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:54:10.822899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:54:10.822899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:54:10.822899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:54:10.822899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:54:10.822899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:54:10.822899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac22b783-e5b8-4433-874b-6c5ccef5eb8b could not be found. Aug 07 22:54:10.822899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:54:10.822899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:54:10.822899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:54:10.822899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:10.822899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:54:10.822899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:54:10.822899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:54:10.822899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:54:10.822899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac22b783-e5b8-4433-874b-6c5ccef5eb8b could not be found. Aug 07 22:54:10.822899 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:54:10.824569 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-d0653083-ecd2-4330-b999-04bf35dd02b7 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Returning 404 to user: Instance ac22b783-e5b8-4433-874b-6c5ccef5eb8b could not be found. {{(pid=129965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:54:10.824569 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-d0653083-ecd2-4330-b999-04bf35dd02b7 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b" status: 404 len: 111 microversion: 2.1 time: 0.030304 Aug 07 22:54:10.824569 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 552/1127] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:54:10 2022] GET /compute/v2.1/servers/ac22b783-e5b8-4433-874b-6c5ccef5eb8b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:54:12.112544 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-1c3e35a0-511e-4cdc-b78e-5ce0a408ca54 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:54:12.113078 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-1c3e35a0-511e-4cdc-b78e-5ce0a408ca54 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:54:12.119305 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1c3e35a0-511e-4cdc-b78e-5ce0a408ca54 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:12.119898 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1c3e35a0-511e-4cdc-b78e-5ce0a408ca54 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:12.120403 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1c3e35a0-511e-4cdc-b78e-5ce0a408ca54 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:12.121087 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1c3e35a0-511e-4cdc-b78e-5ce0a408ca54 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:12.121532 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1c3e35a0-511e-4cdc-b78e-5ce0a408ca54 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:12.121952 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-1c3e35a0-511e-4cdc-b78e-5ce0a408ca54 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:12.134868 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-1c3e35a0-511e-4cdc-b78e-5ce0a408ca54 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] HTTP exception thrown: Instance 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf could not be found. Aug 07 22:54:12.137218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-1c3e35a0-511e-4cdc-b78e-5ce0a408ca54 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Request method failure captured: Aug 07 22:54:12.137218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: DELETE /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf HTTP/1.1 Aug 07 22:54:12.137218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:54:12.137218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:54:12.137218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:54:12.137218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:54:12.137218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:54:12.137218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:54:12.137218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:54:12.137218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:54:12.137218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8EGBVDt0B4T4NuqEVjly370CcefohZV8ujFPZ9aeuiXaRepQ4CoO-34qEEnDnCocUGVNEgiqPEON8F186gqTH91_Is0rvdIVNvdqPDy0X1A6jSCDPucnV0BigazZ7r8jyjsVUtC-BkDw2_ipoRYfpl4-MpZdfC7_1mPtbFtkdVE296w Aug 07 22:54:12.137218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:54:12.137218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:54:12.137218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:54:12.137218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:54:12.137218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:54:12.137218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:54:12.137218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:54:12.137218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:12.137218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:54:12.137218 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:54:12.138981 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:54:12.138981 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:12.138981 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:54:12.138981 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:12.138981 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:54:12.138981 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:54:12.138981 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:54:12.138981 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: 13c06492c8db44759185686bd0a11a57 Aug 07 22:54:12.138981 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:54:12.138981 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: > Aug 07 22:54:12.138981 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Instance 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf could not be found. Aug 07 22:54:12.138981 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': '16ab4ae6-8135-4ba5-8fff-4a25f284a1cf'} Aug 07 22:54:12.139960 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:54:12.139960 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:12.139960 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:54:12.139960 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:54:12.139960 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:54:12.139960 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:54:12.139960 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:54:12.139960 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:54:12.139960 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:54:12.139960 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:54:12.139960 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf could not be found. Aug 07 22:54:12.139960 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:54:12.139960 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:54:12.139960 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:54:12.139960 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:12.139960 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:54:12.139960 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:54:12.139960 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:54:12.139960 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:54:12.139960 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:54:12.141602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:54:12.141602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 22:54:12.141602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 22:54:12.141602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 22:54:12.141602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 22:54:12.141602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:54:12.141602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:54:12.141602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:54:12.141602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:54:12.141602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf could not be found. Aug 07 22:54:12.141602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:54:12.141602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:54:12.141602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:54:12.141602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:12.141602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:54:12.141602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:54:12.141602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:54:12.141602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:54:12.141602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf could not be found. Aug 07 22:54:12.141602 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:54:12.143603 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-1c3e35a0-511e-4cdc-b78e-5ce0a408ca54 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Returning 404 to user: Instance 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:54:12.143603 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-1c3e35a0-511e-4cdc-b78e-5ce0a408ca54 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "DELETE /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf" status: 404 len: 111 microversion: 2.1 time: 0.030015 Aug 07 22:54:12.143603 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 576/1128] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:54:12 2022] DELETE /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 22:54:12.147557 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-4a1b32a9-fb6e-438a-9b42-4ba81691cef0 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:54:12.148230 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-4a1b32a9-fb6e-438a-9b42-4ba81691cef0 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:54:12.155086 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4a1b32a9-fb6e-438a-9b42-4ba81691cef0 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:12.155556 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4a1b32a9-fb6e-438a-9b42-4ba81691cef0 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:12.155989 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4a1b32a9-fb6e-438a-9b42-4ba81691cef0 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:12.156784 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4a1b32a9-fb6e-438a-9b42-4ba81691cef0 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:12.157236 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4a1b32a9-fb6e-438a-9b42-4ba81691cef0 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:12.157659 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-4a1b32a9-fb6e-438a-9b42-4ba81691cef0 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:12.171327 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.wsgi [None req-4a1b32a9-fb6e-438a-9b42-4ba81691cef0 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] HTTP exception thrown: Instance 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf could not be found. Aug 07 22:54:12.172854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-4a1b32a9-fb6e-438a-9b42-4ba81691cef0 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Request method failure captured: Aug 07 22:54:12.172854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: request: GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf HTTP/1.1 Aug 07 22:54:12.172854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept: application/json Aug 07 22:54:12.172854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept-Encoding: identity Aug 07 22:54:12.172854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Connection: close Aug 07 22:54:12.172854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Length: 0 Aug 07 22:54:12.172854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Type: application/json Aug 07 22:54:12.172854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Host: 10.222.0.30 Aug 07 22:54:12.172854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Openstack-System-Scope: None Aug 07 22:54:12.172854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: User-Agent: python-urllib3/1.26.11 Aug 07 22:54:12.172854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Auth-Token: gAAAAABi8EGBVDt0B4T4NuqEVjly370CcefohZV8ujFPZ9aeuiXaRepQ4CoO-34qEEnDnCocUGVNEgiqPEON8F186gqTH91_Is0rvdIVNvdqPDy0X1A6jSCDPucnV0BigazZ7r8jyjsVUtC-BkDw2_ipoRYfpl4-MpZdfC7_1mPtbFtkdVE296w Aug 07 22:54:12.172854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Id: None Aug 07 22:54:12.172854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Name: None Aug 07 22:54:12.172854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Identity-Status: Confirmed Aug 07 22:54:12.172854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Is-Admin-Project: True Aug 07 22:54:12.172854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Id: default Aug 07 22:54:12.172854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Name: Default Aug 07 22:54:12.172854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:54:12.172854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:12.172854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Role: reader,member Aug 07 22:54:12.172854 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Roles: reader,member Aug 07 22:54:12.174503 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:54:12.174503 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:12.174503 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:54:12.174503 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:12.174503 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:54:12.174503 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Id: default Aug 07 22:54:12.174503 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Name: Default Aug 07 22:54:12.174503 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Id: 13c06492c8db44759185686bd0a11a57 Aug 07 22:54:12.174503 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Name: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:54:12.174503 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: method: > Aug 07 22:54:12.174503 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: exception: Instance 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf could not be found. Aug 07 22:54:12.174503 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: action_args: {'id': '16ab4ae6-8135-4ba5-8fff-4a25f284a1cf'} Aug 07 22:54:12.175450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:54:12.175450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:12.175450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:54:12.175450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:54:12.175450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:54:12.175450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:54:12.175450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:54:12.175450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:54:12.175450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:54:12.175450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:54:12.175450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf could not be found. Aug 07 22:54:12.175450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:54:12.175450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:54:12.175450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:54:12.175450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:12.175450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:54:12.175450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:54:12.175450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:54:12.175450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:54:12.175450 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:54:12.177236 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:54:12.177236 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:54:12.177236 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:54:12.177236 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:54:12.177236 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:54:12.177236 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:54:12.177236 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:54:12.177236 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf could not be found. Aug 07 22:54:12.177236 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:54:12.177236 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:54:12.177236 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:54:12.177236 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:12.177236 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:54:12.177236 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:54:12.177236 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:54:12.177236 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:54:12.177236 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf could not be found. Aug 07 22:54:12.177236 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:54:12.178595 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-4a1b32a9-fb6e-438a-9b42-4ba81691cef0 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Returning 404 to user: Instance 16ab4ae6-8135-4ba5-8fff-4a25f284a1cf could not be found. {{(pid=129965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:54:12.178595 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-4a1b32a9-fb6e-438a-9b42-4ba81691cef0 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf" status: 404 len: 111 microversion: 2.1 time: 0.030572 Aug 07 22:54:12.178595 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 553/1129] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:54:12 2022] GET /compute/v2.1/servers/16ab4ae6-8135-4ba5-8fff-4a25f284a1cf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:54:12.183326 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-945c1519-c84e-43a9-bd51-d93b2f002652 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:54:12.183828 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-945c1519-c84e-43a9-bd51-d93b2f002652 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:54:12.189821 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-945c1519-c84e-43a9-bd51-d93b2f002652 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:12.190350 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-945c1519-c84e-43a9-bd51-d93b2f002652 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:12.191146 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-945c1519-c84e-43a9-bd51-d93b2f002652 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:12.191853 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-945c1519-c84e-43a9-bd51-d93b2f002652 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:12.192334 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-945c1519-c84e-43a9-bd51-d93b2f002652 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:12.192766 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-945c1519-c84e-43a9-bd51-d93b2f002652 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:12.205891 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-945c1519-c84e-43a9-bd51-d93b2f002652 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] HTTP exception thrown: Instance 0cdd262a-57b5-44bd-a4e0-541425bd19c6 could not be found. Aug 07 22:54:12.207405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-945c1519-c84e-43a9-bd51-d93b2f002652 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Request method failure captured: Aug 07 22:54:12.207405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: DELETE /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6 HTTP/1.1 Aug 07 22:54:12.207405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:54:12.207405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:54:12.207405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:54:12.207405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:54:12.207405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:54:12.207405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:54:12.207405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:54:12.207405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:54:12.207405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8EGBVDt0B4T4NuqEVjly370CcefohZV8ujFPZ9aeuiXaRepQ4CoO-34qEEnDnCocUGVNEgiqPEON8F186gqTH91_Is0rvdIVNvdqPDy0X1A6jSCDPucnV0BigazZ7r8jyjsVUtC-BkDw2_ipoRYfpl4-MpZdfC7_1mPtbFtkdVE296w Aug 07 22:54:12.207405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:54:12.207405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:54:12.207405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:54:12.207405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:54:12.207405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:54:12.207405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:54:12.207405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:54:12.207405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:12.207405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:54:12.207405 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:54:12.209157 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:54:12.209157 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:12.209157 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:54:12.209157 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:12.209157 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:54:12.209157 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:54:12.209157 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:54:12.209157 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: 13c06492c8db44759185686bd0a11a57 Aug 07 22:54:12.209157 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:54:12.209157 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: > Aug 07 22:54:12.209157 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Instance 0cdd262a-57b5-44bd-a4e0-541425bd19c6 could not be found. Aug 07 22:54:12.209157 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': '0cdd262a-57b5-44bd-a4e0-541425bd19c6'} Aug 07 22:54:12.210108 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:54:12.210108 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:12.210108 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:54:12.210108 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:54:12.210108 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:54:12.210108 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:54:12.210108 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:54:12.210108 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:54:12.210108 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:54:12.210108 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:54:12.210108 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cdd262a-57b5-44bd-a4e0-541425bd19c6 could not be found. Aug 07 22:54:12.210108 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:54:12.210108 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:54:12.210108 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:54:12.210108 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:12.210108 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:54:12.210108 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:54:12.210108 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:54:12.210108 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:54:12.210108 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:54:12.211700 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:54:12.211700 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 22:54:12.211700 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 22:54:12.211700 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 22:54:12.211700 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 22:54:12.211700 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:54:12.211700 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:54:12.211700 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:54:12.211700 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:54:12.211700 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cdd262a-57b5-44bd-a4e0-541425bd19c6 could not be found. Aug 07 22:54:12.211700 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:54:12.211700 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:54:12.211700 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:54:12.211700 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:12.211700 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:54:12.211700 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:54:12.211700 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:54:12.211700 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:54:12.211700 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cdd262a-57b5-44bd-a4e0-541425bd19c6 could not be found. Aug 07 22:54:12.211700 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:54:12.213947 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-945c1519-c84e-43a9-bd51-d93b2f002652 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Returning 404 to user: Instance 0cdd262a-57b5-44bd-a4e0-541425bd19c6 could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:54:12.213947 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-945c1519-c84e-43a9-bd51-d93b2f002652 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6" status: 404 len: 111 microversion: 2.1 time: 0.029397 Aug 07 22:54:12.213947 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 577/1130] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:54:12 2022] DELETE /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:54:12.217803 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-35372580-b32e-437b-8ea8-562df7d25951 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:54:12.218454 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-35372580-b32e-437b-8ea8-562df7d25951 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: 0cdd262a-57b5-44bd-a4e0-541425bd19c6] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:54:12.224503 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-35372580-b32e-437b-8ea8-562df7d25951 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:12.224975 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-35372580-b32e-437b-8ea8-562df7d25951 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:12.225411 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-35372580-b32e-437b-8ea8-562df7d25951 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:12.226096 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-35372580-b32e-437b-8ea8-562df7d25951 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:12.226549 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-35372580-b32e-437b-8ea8-562df7d25951 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:12.226981 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-35372580-b32e-437b-8ea8-562df7d25951 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:12.242048 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.wsgi [None req-35372580-b32e-437b-8ea8-562df7d25951 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] HTTP exception thrown: Instance 0cdd262a-57b5-44bd-a4e0-541425bd19c6 could not be found. Aug 07 22:54:12.243537 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-35372580-b32e-437b-8ea8-562df7d25951 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Request method failure captured: Aug 07 22:54:12.243537 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: request: GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6 HTTP/1.1 Aug 07 22:54:12.243537 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept: application/json Aug 07 22:54:12.243537 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept-Encoding: identity Aug 07 22:54:12.243537 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Connection: close Aug 07 22:54:12.243537 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Length: 0 Aug 07 22:54:12.243537 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Type: application/json Aug 07 22:54:12.243537 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Host: 10.222.0.30 Aug 07 22:54:12.243537 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Openstack-System-Scope: None Aug 07 22:54:12.243537 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: User-Agent: python-urllib3/1.26.11 Aug 07 22:54:12.243537 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Auth-Token: gAAAAABi8EGBVDt0B4T4NuqEVjly370CcefohZV8ujFPZ9aeuiXaRepQ4CoO-34qEEnDnCocUGVNEgiqPEON8F186gqTH91_Is0rvdIVNvdqPDy0X1A6jSCDPucnV0BigazZ7r8jyjsVUtC-BkDw2_ipoRYfpl4-MpZdfC7_1mPtbFtkdVE296w Aug 07 22:54:12.243537 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Id: None Aug 07 22:54:12.243537 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Name: None Aug 07 22:54:12.243537 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Identity-Status: Confirmed Aug 07 22:54:12.243537 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Is-Admin-Project: True Aug 07 22:54:12.243537 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Id: default Aug 07 22:54:12.243537 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Name: Default Aug 07 22:54:12.243537 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:54:12.243537 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:12.243537 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Role: reader,member Aug 07 22:54:12.243537 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Roles: reader,member Aug 07 22:54:12.245416 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:54:12.245416 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:12.245416 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:54:12.245416 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:12.245416 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:54:12.245416 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Id: default Aug 07 22:54:12.245416 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Name: Default Aug 07 22:54:12.245416 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Id: 13c06492c8db44759185686bd0a11a57 Aug 07 22:54:12.245416 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Name: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:54:12.245416 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: method: > Aug 07 22:54:12.245416 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: exception: Instance 0cdd262a-57b5-44bd-a4e0-541425bd19c6 could not be found. Aug 07 22:54:12.245416 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: action_args: {'id': '0cdd262a-57b5-44bd-a4e0-541425bd19c6'} Aug 07 22:54:12.246375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:54:12.246375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:12.246375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:54:12.246375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:54:12.246375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:54:12.246375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:54:12.246375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:54:12.246375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:54:12.246375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:54:12.246375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:54:12.246375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cdd262a-57b5-44bd-a4e0-541425bd19c6 could not be found. Aug 07 22:54:12.246375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:54:12.246375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:54:12.246375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:54:12.246375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:12.246375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:54:12.246375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:54:12.246375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:54:12.246375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:54:12.246375 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:54:12.247947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:54:12.247947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:54:12.247947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:54:12.247947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:54:12.247947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:54:12.247947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:54:12.247947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:54:12.247947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cdd262a-57b5-44bd-a4e0-541425bd19c6 could not be found. Aug 07 22:54:12.247947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:54:12.247947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:54:12.247947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:54:12.247947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:12.247947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:54:12.247947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:54:12.247947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:54:12.247947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:54:12.247947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cdd262a-57b5-44bd-a4e0-541425bd19c6 could not be found. Aug 07 22:54:12.247947 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:54:12.249539 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-35372580-b32e-437b-8ea8-562df7d25951 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Returning 404 to user: Instance 0cdd262a-57b5-44bd-a4e0-541425bd19c6 could not be found. {{(pid=129965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:54:12.249539 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-35372580-b32e-437b-8ea8-562df7d25951 tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6" status: 404 len: 111 microversion: 2.1 time: 0.031642 Aug 07 22:54:12.249539 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 554/1131] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:54:12 2022] GET /compute/v2.1/servers/0cdd262a-57b5-44bd-a4e0-541425bd19c6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 22:54:13.559579 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-68e95b32-f7ad-4184-bc42-d5be69b97e1c tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:54:13.560078 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.compute.api [None req-68e95b32-f7ad-4184-bc42-d5be69b97e1c tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129964) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:54:13.566384 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-68e95b32-f7ad-4184-bc42-d5be69b97e1c tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:13.566853 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-68e95b32-f7ad-4184-bc42-d5be69b97e1c tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:13.567283 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-68e95b32-f7ad-4184-bc42-d5be69b97e1c tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:13.567961 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-68e95b32-f7ad-4184-bc42-d5be69b97e1c tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:13.568432 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-68e95b32-f7ad-4184-bc42-d5be69b97e1c tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:13.568858 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG oslo_concurrency.lockutils [None req-68e95b32-f7ad-4184-bc42-d5be69b97e1c tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:13.582051 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.wsgi [None req-68e95b32-f7ad-4184-bc42-d5be69b97e1c tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] HTTP exception thrown: Instance a5d89236-5cd5-455e-896a-82d335ebf25d could not be found. Aug 07 22:54:13.583553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-68e95b32-f7ad-4184-bc42-d5be69b97e1c tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Request method failure captured: Aug 07 22:54:13.583553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: request: DELETE /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d HTTP/1.1 Aug 07 22:54:13.583553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept: application/json Aug 07 22:54:13.583553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Accept-Encoding: identity Aug 07 22:54:13.583553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Connection: close Aug 07 22:54:13.583553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Length: 0 Aug 07 22:54:13.583553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Content-Type: application/json Aug 07 22:54:13.583553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Host: 10.222.0.30 Aug 07 22:54:13.583553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Openstack-System-Scope: None Aug 07 22:54:13.583553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: User-Agent: python-urllib3/1.26.11 Aug 07 22:54:13.583553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Auth-Token: gAAAAABi8EGBVDt0B4T4NuqEVjly370CcefohZV8ujFPZ9aeuiXaRepQ4CoO-34qEEnDnCocUGVNEgiqPEON8F186gqTH91_Is0rvdIVNvdqPDy0X1A6jSCDPucnV0BigazZ7r8jyjsVUtC-BkDw2_ipoRYfpl4-MpZdfC7_1mPtbFtkdVE296w Aug 07 22:54:13.583553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Id: None Aug 07 22:54:13.583553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Domain-Name: None Aug 07 22:54:13.583553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Identity-Status: Confirmed Aug 07 22:54:13.583553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Is-Admin-Project: True Aug 07 22:54:13.583553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Id: default Aug 07 22:54:13.583553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Domain-Name: Default Aug 07 22:54:13.583553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:54:13.583553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Project-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:13.583553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Role: reader,member Aug 07 22:54:13.583553 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Roles: reader,member Aug 07 22:54:13.585148 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:54:13.585148 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:13.585148 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:54:13.585148 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:13.585148 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:54:13.585148 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Id: default Aug 07 22:54:13.585148 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Domain-Name: Default Aug 07 22:54:13.585148 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Id: 13c06492c8db44759185686bd0a11a57 Aug 07 22:54:13.585148 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: X-User-Name: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:54:13.585148 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: method: > Aug 07 22:54:13.585148 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: exception: Instance a5d89236-5cd5-455e-896a-82d335ebf25d could not be found. Aug 07 22:54:13.585148 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: action_args: {'id': 'a5d89236-5cd5-455e-896a-82d335ebf25d'} Aug 07 22:54:13.586039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: {{(pid=129964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:54:13.586039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:13.586039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:54:13.586039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:54:13.586039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:54:13.586039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:54:13.586039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:54:13.586039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:54:13.586039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:54:13.586039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:54:13.586039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5d89236-5cd5-455e-896a-82d335ebf25d could not be found. Aug 07 22:54:13.586039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:54:13.586039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:54:13.586039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:54:13.586039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:13.586039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:54:13.586039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:54:13.586039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:54:13.586039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:54:13.586039 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:54:13.587761 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:54:13.587761 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 22:54:13.587761 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 22:54:13.587761 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 22:54:13.587761 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 22:54:13.587761 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:54:13.587761 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:54:13.587761 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:54:13.587761 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:54:13.587761 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5d89236-5cd5-455e-896a-82d335ebf25d could not be found. Aug 07 22:54:13.587761 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:54:13.587761 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:54:13.587761 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:54:13.587761 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:13.587761 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:54:13.587761 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:54:13.587761 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:54:13.587761 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:54:13.587761 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5d89236-5cd5-455e-896a-82d335ebf25d could not be found. Aug 07 22:54:13.587761 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: ERROR nova.api.openstack.wsgi Aug 07 22:54:13.590233 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: DEBUG nova.api.openstack.wsgi [None req-68e95b32-f7ad-4184-bc42-d5be69b97e1c tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Returning 404 to user: Instance a5d89236-5cd5-455e-896a-82d335ebf25d could not be found. {{(pid=129964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:54:13.590233 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO nova.api.openstack.requestlog [None req-68e95b32-f7ad-4184-bc42-d5be69b97e1c tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d" status: 404 len: 111 microversion: 2.1 time: 0.030036 Aug 07 22:54:13.590233 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: [pid: 129964|app: 0|req: 578/1132] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 22:54:13 2022] DELETE /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 22:54:13.593915 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-5102d59b-5d19-4505-b8e1-9df7352a6fad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Calling method '>' {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 22:54:13.594572 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.compute.api [None req-5102d59b-5d19-4505-b8e1-9df7352a6fad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] [instance: a5d89236-5cd5-455e-896a-82d335ebf25d] Fetching instance by UUID {{(pid=129965) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 22:54:13.601182 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5102d59b-5d19-4505-b8e1-9df7352a6fad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:13.601675 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5102d59b-5d19-4505-b8e1-9df7352a6fad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:13.602118 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5102d59b-5d19-4505-b8e1-9df7352a6fad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:13.602875 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5102d59b-5d19-4505-b8e1-9df7352a6fad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Acquiring lock "6956e3f3-38cc-4e73-875d-dafdec061360" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 22:54:13.603358 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5102d59b-5d19-4505-b8e1-9df7352a6fad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 22:54:13.603819 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG oslo_concurrency.lockutils [None req-5102d59b-5d19-4505-b8e1-9df7352a6fad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Lock "6956e3f3-38cc-4e73-875d-dafdec061360" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 22:54:13.617937 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.wsgi [None req-5102d59b-5d19-4505-b8e1-9df7352a6fad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] HTTP exception thrown: Instance a5d89236-5cd5-455e-896a-82d335ebf25d could not be found. Aug 07 22:54:13.619437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-5102d59b-5d19-4505-b8e1-9df7352a6fad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Request method failure captured: Aug 07 22:54:13.619437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: request: GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d HTTP/1.1 Aug 07 22:54:13.619437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept: application/json Aug 07 22:54:13.619437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Accept-Encoding: identity Aug 07 22:54:13.619437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Connection: close Aug 07 22:54:13.619437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Length: 0 Aug 07 22:54:13.619437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Content-Type: application/json Aug 07 22:54:13.619437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Host: 10.222.0.30 Aug 07 22:54:13.619437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Openstack-System-Scope: None Aug 07 22:54:13.619437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: User-Agent: python-urllib3/1.26.11 Aug 07 22:54:13.619437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Auth-Token: gAAAAABi8EGBVDt0B4T4NuqEVjly370CcefohZV8ujFPZ9aeuiXaRepQ4CoO-34qEEnDnCocUGVNEgiqPEON8F186gqTH91_Is0rvdIVNvdqPDy0X1A6jSCDPucnV0BigazZ7r8jyjsVUtC-BkDw2_ipoRYfpl4-MpZdfC7_1mPtbFtkdVE296w Aug 07 22:54:13.619437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Id: None Aug 07 22:54:13.619437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Domain-Name: None Aug 07 22:54:13.619437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Identity-Status: Confirmed Aug 07 22:54:13.619437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Is-Admin-Project: True Aug 07 22:54:13.619437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Id: default Aug 07 22:54:13.619437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Domain-Name: Default Aug 07 22:54:13.619437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:54:13.619437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Project-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:13.619437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Role: reader,member Aug 07 22:54:13.619437 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Roles: reader,member Aug 07 22:54:13.621238 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4571d38eeff749fcb073842d5ad4fc65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 07 22:54:13.621238 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:13.621238 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Id: 4571d38eeff749fcb073842d5ad4fc65 Aug 07 22:54:13.621238 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2010488842 Aug 07 22:54:13.621238 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:54:13.621238 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Id: default Aug 07 22:54:13.621238 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Domain-Name: Default Aug 07 22:54:13.621238 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Id: 13c06492c8db44759185686bd0a11a57 Aug 07 22:54:13.621238 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: X-User-Name: tempest-AttachVolumeNegativeTest-2010488842-project Aug 07 22:54:13.621238 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: method: > Aug 07 22:54:13.621238 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: exception: Instance a5d89236-5cd5-455e-896a-82d335ebf25d could not be found. Aug 07 22:54:13.621238 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: action_args: {'id': 'a5d89236-5cd5-455e-896a-82d335ebf25d'} Aug 07 22:54:13.622210 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: {{(pid=129965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 22:54:13.622210 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:13.622210 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 22:54:13.622210 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 22:54:13.622210 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 22:54:13.622210 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 22:54:13.622210 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 22:54:13.622210 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 22:54:13.622210 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 22:54:13.622210 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 22:54:13.622210 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5d89236-5cd5-455e-896a-82d335ebf25d could not be found. Aug 07 22:54:13.622210 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:54:13.622210 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:54:13.622210 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:54:13.622210 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:13.622210 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:54:13.622210 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:54:13.622210 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 22:54:13.622210 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 22:54:13.622210 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 22:54:13.623770 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 22:54:13.623770 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 22:54:13.623770 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 22:54:13.623770 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 22:54:13.623770 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 22:54:13.623770 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 22:54:13.623770 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 22:54:13.623770 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5d89236-5cd5-455e-896a-82d335ebf25d could not be found. Aug 07 22:54:13.623770 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:54:13.623770 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 22:54:13.623770 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:54:13.623770 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 22:54:13.623770 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 22:54:13.623770 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 22:54:13.623770 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 22:54:13.623770 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 22:54:13.623770 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5d89236-5cd5-455e-896a-82d335ebf25d could not be found. Aug 07 22:54:13.623770 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: ERROR nova.api.openstack.wsgi Aug 07 22:54:13.625195 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: DEBUG nova.api.openstack.wsgi [None req-5102d59b-5d19-4505-b8e1-9df7352a6fad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] Returning 404 to user: Instance a5d89236-5cd5-455e-896a-82d335ebf25d could not be found. {{(pid=129965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 22:54:13.625195 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO nova.api.openstack.requestlog [None req-5102d59b-5d19-4505-b8e1-9df7352a6fad tempest-AttachVolumeNegativeTest-2010488842 tempest-AttachVolumeNegativeTest-2010488842-project] 10.222.0.30 "GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d" status: 404 len: 111 microversion: 2.1 time: 0.031018 Aug 07 22:54:13.625195 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: [pid: 129965|app: 0|req: 555/1133] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 22:54:13 2022] GET /compute/v2.1/servers/a5d89236-5cd5-455e-896a-82d335ebf25d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 22:55:55.211651 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 22:55:55.212371 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Sun Aug 7 22:55:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 22:55:55.738505 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 22:55:55.739054 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Sun Aug 7 22:55:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 22:56:33.173571 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 22:56:33.174474 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Sun Aug 7 22:56:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 22:57:09.384579 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 22:57:09.385172 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Sun Aug 7 22:57:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 22:57:34.905631 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 22:57:34.906248 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Sun Aug 7 22:57:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 22:59:15.219673 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 22:59:15.220293 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Sun Aug 7 22:59:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 22:59:15.746598 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 22:59:15.747092 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Sun Aug 7 22:59:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 22:59:26.118429 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 22:59:26.118943 dv-cinder-850321-3-iscsi devstack@n-api.service[129965]: Sun Aug 7 22:59:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 22:59:53.181498 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 22:59:53.182073 dv-cinder-850321-3-iscsi devstack@n-api.service[129964]: Sun Aug 7 22:59:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!